Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

49,789

Base only

Active filters: 4-bit

mlx-community/DeepSeek-R1-0528-Qwen3-8B-4bit

Text Generation • 8B • Updated May 30, 2025 • 1.94k • 8

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-4bit

Text Generation • 31B • Updated Jul 31, 2025 • 141k • 39

mlx-community/Qwen3-Coder-30B-A3B-Instruct-4bit

Text Generation • 31B • Updated Aug 6, 2025 • 10.6k • 40

mlx-community/GLM-4.5-Air-mxfp4

Text Generation • 107B • Updated Sep 26, 2025 • 43 • 3

mlx-community/Qwen3-VL-4B-Instruct-4bit

Image-Text-to-Text • 4B • Updated Oct 16, 2025 • 21.1k • 9

unsloth/Qwen3-VL-2B-Instruct-bnb-4bit

Image-Text-to-Text • 2B • Updated Oct 30, 2025 • 8.02k • 4

IDEA-Research/Rex-Omni-AWQ

4B • Updated Oct 31, 2025 • 132k • 5

kaitchup/Qwen3-VL-8B-Instruct-NVFP4

2B • Updated Nov 5, 2025 • 108 • 1

sherif1313/Arabic-handwritten-OCR-4bit-Qwen2.5-VL-3B-v2

Image-to-Text • 4B • Updated Dec 29, 2025 • 359 • 10

mlx-community/Josiefied-Olmo-3-7B-Instruct-abliterated-v1-4bit

Text Generation • 7B • Updated Nov 25, 2025 • 36 • 1

Disty0/Z-Image-Turbo-SDNQ-uint4-svd-r32

Text-to-Image • 3B • Updated Dec 3, 2025 • 6.73k • 65

introvoyz041/DeepSeek-R1-0528-Qwen3-8B-MLX-4bit-mlx-4Bit

Text Generation • 8B • Updated Nov 30, 2025 • 30 • 1

MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF

Text Generation • 3B • Updated Dec 2, 2025 • 151k • 5

mlx-community/Qwen3-8B-abliterated-v2-mxfp4

Text Generation • 8B • Updated Dec 14, 2025 • 446 • 1

Disty0/Qwen-Image-2512-SDNQ-uint4-svd-r32

Text-to-Image • 11B • Updated Jan 6 • 46 • 6

Natsukiz/Phi-4-mini-instruct-bnb-4bit

Text Generation • 4B • Updated Jan 8 • 7 • 1

unsloth/medgemma-1.5-4b-it-bnb-4bit

Image-Text-to-Text • 4B • Updated Jan 14 • 889 • 7

mlx-community/translategemma-27b-it-4bit

Text Generation • 27B • Updated Jan 16 • 276 • 4

nightmedia/OpenAI-gpt-oss-20B-INSTRUCT-Heretic-Uncensored-MXFP4-q8-hi-mlx

Text Generation • 21B • Updated Feb 6 • 1.76k • 7

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 123B • Updated Feb 24 • 5.87k • 20

Qwen/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 36B • Updated Apr 24 • 544k • 92

QuantTrio/Qwen3.5-9B-AWQ

Image-Text-to-Text • 10B • Updated Mar 4 • 1.08M • 27

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.8B • Updated Jul 14 • 1.34k • 23

mlx-community/Qwen3.5-4B-OptiQ-4bit

Text Generation • 4B • Updated Jul 14 • 10.4k • 29

lemuriandezapada/VibeVoice-ASR-awq-int4

Automatic Speech Recognition • 1B • Updated Mar 8 • 39 • 6

TheCluster/Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-MLX-mxfp4

Image-Text-to-Text • 9B • Updated Mar 17 • 6.44k • 19

mlx-community/Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated-4bit

Image-Text-to-Text • 5B • Updated Mar 17 • 728 • 6

Intel/Qwen2.5-Omni-7B-int4-AutoRound

5B • Updated Apr 17 • 612 • 3

LiquidAI/LFM2.5-350M-MLX-4bit

Text Generation • 0.4B • Updated 26 days ago • 1.23k • 12

bigatuna/Qwen3.5-9b-Sushi-Coder-RL-MLX

Text Generation • 9B • Updated Mar 27 • 1.33k • 16