ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16
Text Generation • 6B • Updated • 128 • 10
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
Hardware-Native Joint Sparse-Quantization for Trillion-Scale Mixture-of-Experts
WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms
ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf
Text Generation • 1B • Updated • 43 • 2
ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf
Text Generation • 18B • Updated • 28 • 1
ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf
Text Generation • 9B • Updated • 27 • 6
ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf
Text Generation • 2B • Updated • 21
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf
Text Generation • 2B • Updated • 24
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf
Text Generation • 2B • Updated • 109 • 2
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf
Text Generation • 1B • Updated • 73 • 5
ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf
Text Generation • 7B • Updated • 104 • 23
ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf
Text Generation • 1B • Updated • 24 • 4
ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf
Text Generation • 0.8B • Updated • 28 • 6
ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf
Text Generation • 7B • Updated • 108 • 19
ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf
Text Generation • Updated • 17
ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf
Text Generation • 18B • Updated • 17
ISTA-DASLab/switch-c-2048_qmoe
Updated • 11 • 4
ISTA-DASLab/switch-large-128_qmoe
Updated • 10
ISTA-DASLab/switch-base-128_qmoe
Updated • 13 • 1