Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,844

Base only

Active filters: awq

QuantTrio/Qwen3.6-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated Apr 17 • 789k • 28

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 57.2k • 16

sanskar003/Qwen3.5-4B-AWQ

Image-Text-to-Text • 5B • Updated 7 days ago • 47 • 2

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 305k • 110

Orion-zhen/aya-expanse-32b-AWQ

Text Generation • 34B • Updated Oct 27, 2024 • 180 • 6

LGAI-EXAONE/EXAONE-Deep-32B-AWQ

Text Generation • 32B • Updated Feb 6 • 123 • 21

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21, 2025 • 1.84M • 71

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21, 2025 • 398k • 51

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21, 2025 • 562k • 30

alonsoko/gemma-4-31b-it-abliterated-heretic-AWQ-W4A16

Image-Text-to-Text • 32B • Updated May 17 • 11k • 13

mattbucci/gemma-4-26B-AWQ

26B • Updated May 31 • 19.1k • 1

cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit

Image-Text-to-Text • 36B • Updated 4 days ago • 1.93M • 82

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q8_K_XL-mlx

Text Generation • 10B • Updated May 15 • 653 • 8

QuantTrio/Qwen3.6-27B-AWQ

Image-Text-to-Text • 28B • Updated Apr 23 • 1.48M • 19

Code4me2/bu-30b-a3b-preview-NVFP4

Image-Text-to-Text • 16B • Updated Apr 24 • 13 • 1

shawnw3i/Huihui-Qwen3.6-27B-abliterated-AWQ-MTP

Image-Text-to-Text • 6B • Updated May 22 • 67k • 10

drawais/Qwen3-Embedding-8B-AWQ-INT4

Text Generation • 8B • Updated May 3 • 178k • 4

drawais/Granite-4.1-30B-NVFP4

Text Generation • 16B • Updated May 6 • 341 • 1

mattbucci/gemma-4-12B-AWQ

Image-Text-to-Text • 12B • Updated 30 days ago • 21.9k • 2

sakamakismile/Krea-2-Turbo-NVFP4-AWQ

Text-to-Image • Updated 12 days ago • 213 • 4

BatuhanECB/vibethinker-3b-finance-sft-quantized-v1

Text Generation • 3B • Updated 10 days ago • 45 • 1

Cadododoom/Agents-A1-TextOnly-AWQ-INT4

36B • Updated 1 day ago • 1 • 1

Alennnndy/Qwen3.6-27B-AWQ-4bit

Text Generation • 28B • Updated 4 days ago • 86 • 2

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 14 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 33 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 12 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 11 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 12

casperhansen/opt-125m-awq

Text Generation • 0.2B • Updated Oct 31, 2023 • 123 • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 21 • 1