Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

94

Base only

Active filters: lmstudio

sangwon1472/Gemma-MLX-Studio

8B • Updated Apr 12 • 27

xlr8harder/aria-gemma4-31b-v1-GGUF

Text Generation • 31B • Updated Apr 15 • 49 • 1

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 3.32k • 31

Goro64/qwen2.5-coder-14b-instruct-ai-workshop-poc-gguf

Text Generation • 15B • Updated Apr 18 • 62

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 20 • 1.29k • 32

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q8_0-GGUF

Text Generation • 35B • Updated Apr 23 • 740 • 8

lordx64/Qwen3.6-35B-A3B-Kimi-K2.6-Reasoning-Distilled-GGUF

Text Generation • 35B • Updated Apr 26 • 3.47k • 7

PJRM/Nomi-1-Creative-Q4_0-GGUF

Text Generation • 3B • Updated Apr 27 • 13

kasimat/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated May 5 • 14.4k • 1

apol/gemma4-e2b-social-spain-v12-q4-k-m-gguf-public

Text Generation • 5B • Updated May 5 • 23

KartoffelToby/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-Q8_0-GGUF

Text Generation • 35B • Updated May 6 • 21

HackerTwins/NVIDIA-Nemotron-Labs-3-Elastic-12B-A2B-GGUF

Text Generation • 12B • Updated Jul 4 • 358 • 2

muralcode/How-To-Use-Reasoning-Thinking-Models-and-Create-Them

Text Generation • Updated May 14

jmarianodc/health_food_demo

Text Generation • 1B • Updated May 22 • 34

RemySkye/rwkv7-g1g-7.2b-GGUF

Text Generation • 7B • Updated May 24 • 51 • 1

v102ss/Alice-Qwen3-4B-Instruct-2507-Heretic-Light-GGUF

Text Generation • 4B • Updated May 23 • 91

RemySkye/rwkv7-g1g-13.3b-GGUF

Text Generation • 13B • Updated May 24 • 195 • 1

RemySkye/rwkv7-g1g-7.2b-i1-GGUF

Text Generation • 7B • Updated May 24 • 238

RemySkye/rwkv7-g1g-13.3b-i1-GGUF

Text Generation • 13B • Updated May 24 • 38

wazimondo/Qwen3.6-27B-AEON-Ultimate-Uncensored_2-GGUF

Text Generation • 27B • Updated May 26 • 105

alwaysgood/qwen35_sft_023_dpo-GGUF

Image-Text-to-Text • 4B • Updated Jun 3 • 23

alwaysgood/TranslateQwen_v1-GGUF

Image-Text-to-Text • 4B • Updated Jun 3 • 24

alwaysgood/TranslateQwen_v2-GGUF

Image-Text-to-Text • 4B • Updated Jun 3 • 66

ledgergap/Pollux-4B-Judge-GGUF

Text Generation • 4B • Updated Jun 8 • 31

Noah-H309/Qwen3-0.6B-BF16

0.8B • Updated Jun 11 • 18

lordx64/Qwable-v1-GGUF

Text Generation • 35B • Updated Jun 15 • 1.32k • 39

pankajpandey-dev/qwen3.5-9b-hindi-instruct-GGUF

Text Generation • 9B • Updated Jul 4 • 4.73k • 1

alexokita/mistral-nemo-style-step2000-GGUF

Text Generation • 12B • Updated 27 days ago • 101

wazimondo/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 27 days ago

fv78pd/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated 27 days ago • 259