IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

kwanhee new activity 2 days ago

ISTA-DASLab/Kimi-K2.5-P48NVFP4-MoESQ:diamond degradation

mkleinegger updated a model 4 days ago

ISTA-DASLab/Qwen3-8B-MatGPTQ

mkleinegger new activity 4 days ago

ISTA-DASLab/Qwen3-8B-MatGPTQ:Add metadata and usage example

View all activity

Papers

Hardware-Native Joint Sparse-Quantization for Trillion-Scale Mixture-of-Experts

WUSH-KV: KV Cache Quantization with Data-Adaptive Transforms

View all Papers

ISTA-DASLab 's models 167

ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4-200steps

Text Generation • 1B • Updated Aug 10, 2025 • 46

ISTA-DASLab/Qwen3-8B-FPQuant-RTN-NVFP4

Text Generation • 5B • Updated Aug 4, 2025 • 37

ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-MXFP4

Text Generation • 1B • Updated Aug 4, 2025 • 43

ISTA-DASLab/Qwen3-1.7B-FPQuant-RTN-NVFP4

Text Generation • 1B • Updated Aug 4, 2025 • 44

ISTA-DASLab/Qwen3-4B-FPQuant-RTN-NVFP4

Text Generation • 2B • Updated Aug 4, 2025 • 45

ISTA-DASLab/Qwen3-4B-FPQuant-RTN-MXFP4

Text Generation • 2B • Updated Aug 4, 2025 • 43

ISTA-DASLab/Qwen3-0.6B-FPQuant-RTN-MXFP4

Text Generation • 0.4B • Updated Aug 4, 2025 • 54 • 1

ISTA-DASLab/Qwen3-0.6B-FPQuant-RTN-NVFP4

Text Generation • 0.4B • Updated Aug 4, 2025 • 42

ISTA-DASLab/Qwen3-32B-FPQuant-GPTQ-MXFP4

18B • Updated Jul 24, 2025 • 19

ISTA-DASLab/Qwen3-14B-FPQuant-GPTQ-MXFP4

9B • Updated Jul 24, 2025 • 19

ISTA-DASLab/Qwen3-8B-FPQuant-GPTQ-MXFP4

5B • Updated Jul 24, 2025 • 22

ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-GPTQ-MXFP4

5B • Updated Jul 20, 2025 • 21

ISTA-DASLab/Qwen3-8B-FPQuant-RTNv2-MXFP4

5B • Updated Jul 19, 2025 • 21

ISTA-DASLab/Qwen3-8B-FPQuant-RTN-MXFP4

Text Generation • 5B • Updated Jul 15, 2025 • 34

ISTA-DASLab/DeepSeek-V3-0324-GPTQ-4b-128g-experts

Text Generation • 676B • Updated Jun 3, 2025 • 155 • 3

ISTA-DASLab/DeepSeek-R1-0528-GPTQ-4b-128g-experts

Text Generation • 676B • Updated Jun 2, 2025 • 47 • 5

ISTA-DASLab/gemma-3-12b-it-GPTQ-4b-128g

Image-Text-to-Text • 12B • Updated Apr 13, 2025 • 31.1k • 6

ISTA-DASLab/gemma-3-4b-it-GPTQ-4b-128g

Image-Text-to-Text • 4B • Updated Apr 13, 2025 • 259 • 7

ISTA-DASLab/DeepSeek-R1-GPTQ-4b-128g-experts

Text Generation • 676B • Updated Apr 8, 2025 • 32 • 4

ISTA-DASLab/DeepSeek-R1-GPTQ-4b-128g

Text Generation • 676B • Updated Apr 8, 2025 • 42 • 1

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • 24B • Updated Apr 6, 2025 • 19k • 17

ISTA-DASLab/Llama-2-7b-AQLM-1Bit-1x8-hf

1B • Updated Mar 20, 2025 • 33 • 1

ISTA-DASLab/gemma-3-27b-it-GPTQ-4b-128g

Image-Text-to-Text • 28B • Updated Mar 20, 2025 • 726k • 44

ISTA-DASLab/QuEST-800M-INT4

Text Generation • Updated Feb 19, 2025

ISTA-DASLab/QuEST-800M-INT1

Updated Feb 18, 2025

ISTA-DASLab/QuEST-800M-sparse-INT4

Updated Feb 18, 2025

ISTA-DASLab/DeepSeek-R1-Distill-Qwen-14B-HIGGS-4bit

Text Generation • 5B • Updated Feb 14, 2025 • 30

ISTA-DASLab/DeepSeek-R1-HIGGS-4bit

182B • Updated Feb 14, 2025 • 17

ISTA-DASLab/DeepSeek-R1-Distill-Qwen-32B-HIGGS-4bit

Text Generation • 9B • Updated Feb 14, 2025 • 28

ISTA-DASLab/DeepSeek-R1-Distill-Llama-70B-HIGGS-4bit

Text Generation • 19B • Updated Feb 12, 2025 • 30