Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

136

Base only

Active filters: qat

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated about 1 month ago • 42.1k • 35

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated 1 day ago • 44k • 33

Sikaworld1990/gemma-3-12b-qat-abliterated-sikaworld-fp4-ltx2

Feature Extraction • Updated Mar 11 • 35

SC117/gemma-4-E4B-it-heretic-QAT-GGUF

7B • Updated 29 days ago • 5.19k • 13

FadedRedStar/gemma-4-E2B-it-qat-q4_0-heretic-GGUF

Image-Text-to-Text • 5B • Updated 3 days ago • 920 • 2

Harahan/QVGen-CogVideoX-2B-W4A4

Text-to-Video • Updated Feb 2 • 21 • 2

geotessera/TESSERA-V-1.1

Updated May 27 • 7

KIRILLEVS125/ECAPA-QAT

Updated 29 days ago • 1

SC117/gemma-4-26B-A4B-it-qat-heretic-GGUF

25B • Updated 26 days ago • 29.2k • 17

RachidAR/gemma-4-31B-it-qat-Q4_0-Q4emb-MTP-assistant-gguf

0.5B • Updated 29 days ago • 2.98k • 5

FreedomAISVR/Gemma-4-26B-A4B-it-QAT-NVFP4-GGUF

25B • Updated 18 days ago • 2.82k • 2

mlx-community/gemma-4-e4b-it-qat-OptiQ-4bit

Text Generation • 7B • Updated 11 days ago • 4.79k • 8

leonsarmiento/Huihui-gemma-4-26B-A4B-it-qat-6bit-XL-mlx

Image-Text-to-Text • 26B • Updated 4 days ago • 434 • 1

Thomaschtl/qwen3-0.6b-qat-test

Text Generation • Updated Jun 3, 2025

Thomaschtl/qwen3-06b-qat-test

Text Generation • Updated Jun 3, 2025 • 1

Thomaschtl/test2

Text Generation • Updated Jun 4, 2025 • 7

Thomaschtl/test3

Text Generation • Updated Jun 4, 2025 • 5

PKU-DS-LAB/Fairy2i-W2

Text Generation • 7B • Updated Dec 12, 2025 • 86 • • 2

mradermacher/Fairy2i-W2-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 46

mradermacher/Fairy2i-W2-i1-GGUF

Text Generation • 7B • Updated Dec 10, 2025 • 28

thebajajra/RexReranker-0.6B-MXFP4

Text Ranking • 0.5B • Updated Jan 24 • 3 • 3

Adanmohh/apuri-v3-0.6b-sft-qat-gguf

0.6B • Updated Jan 14

junzzhu/atomllama-33K-5x5-DigitMesh-sparse-q8

Text Generation • 34.7k • Updated Jan 15 • 5

tokenlabsdotrun/Llama-3.1-8B-Unsloth-FP8_INT4-QAT

Text Generation • Updated Jan 19 • 2

Harahan/QVGen-Wan-1_3B-W4A4

Text-to-Video • Updated Feb 2 • 9 • 2

kusakana/ReasoningQAT-Qwen3-1.7B-3bit

2B • Updated Mar 20 • 4

kusakana/ReasoningQAT-Qwen3-1.7B-2bit

2B • Updated Mar 20 • 19

kusakana/ReasoningQAT-Qwen3-4B-3bit

4B • Updated Mar 20 • 5

kusakana/ReasoningQAT-Qwen3-4B-2bit

4B • Updated Mar 20 • 17

kusakana/ReasoningQAT-Qwen3-8B-3bit

8B • Updated Mar 20 • 2