Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,532

Base only

Active filters: 3-bit

Evrmind/EVR-1-Maano-8b

Text Generation • 5B • Updated Mar 13 • 40

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-English-128samples

8B • Updated Mar 5 • 3

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Indonesian-128samples

8B • Updated Mar 5 • 2

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Tamil-128samples

8B • Updated Mar 5 • 3

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Swahili-128samples

8B • Updated Mar 5 • 3

fifrio/Llama-3.1-8B-Instruct-gptq-3bit-calibration-Chinese-128samples

8B • Updated Mar 5 • 3

RepublicOfKorokke/Qwen3.5-27B-mlx-lm-3bit

Text Generation • 27B • Updated Mar 8 • 41 • 1

duolaf/Yi-1.5-6B-Chat-GGUF

Text Generation • 6B • Updated Mar 9 • 88

mlx-community/Gemma-SEA-LION-v4-4B-VL-mlx-3bit

Image-Text-to-Text • 5B • Updated Mar 10 • 18

alankessler/Mistral-Nemo-Instruct-2407-MLX-3bit

12B • Updated Mar 11 • 12

alankessler/Mistral-Small-3.2-24B-Instruct-2506-MLX-3bit

24B • Updated Mar 11 • 15

MetaphoricalCode/Qwen3.5-27B-heretic-v2-exl3-3bpw-hb6

Text Generation • 7B • Updated Mar 12 • 9 • 1

Evrmind/EVR-1-Maano-8b-Instruct

Text Generation • 5B • Updated Mar 13 • 51

Evrmind/EVR-1-Bafethu-8b-Reasoning

Text Generation • 5B • Updated Mar 13 • 8

telvenes/Qwen-3.5-35B-A3B-3bit-Norsk-1024

33B • Updated Mar 14 • 7

MoringLabs/Qwen3.5-122B-A10B-MLX-3.7bit-VL

Image-Text-to-Text • 123B • Updated Apr 5 • 134

MoringLabs/GPT-OSS-120B-MLX-3.6bit

Text Generation • 117B • Updated Mar 18 • 68

telvenes/Qwen3.5-27B-abliterated-GPTQ-3bit

25B • Updated Mar 16 • 5

MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit

Text Generation • 121B • Updated Mar 18 • 413 • 7

Brooooooklyn/Qwen3.5-9B-unsloth-mlx

Text Generation • 9B • Updated Mar 24 • 501 • 13

crazyartgeneration/RP-Spectrum-24B-mlx-3Bit

Text Generation • 24B • Updated Mar 19 • 12

ykarout/Qwen3.5-27B-exl3-3.0bpw

Image-Text-to-Text • 7B • Updated Mar 20 • 23 • 2

agustim/ALIA-40b-GPTQ-INT4_3b

4B • Updated Mar 20 • 5

agustim/ALIA-40b-AutoRound-INT4_3b

4B • Updated Mar 20 • 2

spicyneuron/Qwen3.5-397B-A17B-MLX-3.5bit

Text Generation • 396B • Updated Apr 10 • 42

matthewdubois/GLM-OCR-3bit-mlx

Image-Text-to-Text • 1B • Updated Mar 23 • 16 • 1

Brooooooklyn/Qwen3.5-27B-unsloth-mlx

Text Generation • 27B • Updated Mar 24 • 596 • 18

TomerGamerTV/Peach-2.0-9B-8k-Roleplay-MLX-Q3

Text Generation • 9B • Updated Mar 24 • 148

RepublicOfKorokke/Qwen3.5-4B-oQ3.5

Text Generation • 5B • Updated Mar 24 • 7

DeathGodlike/Crownelius_Crow-9B-HERETIC-4.6_EXL3

Text Generation • Updated Mar 31 • 6 • 2