Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

419

Base only

Active filters: local-llm

yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jun 19 • 616k • 1.53k

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 19 • 520k • 2.87k

peonist-ai/halogen-qwen3.8-flash-next

Text Generation • Updated 3 days ago • 9

SpeakoFlow/speakoflow-mini

Text Generation • 0.8B • Updated 9 days ago • 4.22k • 11

yuxinlu1/gemma-4-12B-it-Claude-4.6-4.8-Opus-GGUF

Text Generation • 12B • Updated Jun 18 • 4.13k • 123

albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE

Text Generation • 73B • Updated 2 days ago • 241 • 3

yuxinlu1/Mellum2-12B-A2.5B-Claude-4.6-4.8-Opus-Thinking-GGUF

Text Generation • 12B • Updated Jun 9 • 1.03k • 37

huihui-ai/Huihui-gemma-4-12B-agentic-fable5-abliterated-GGUF

Text Generation • 12B • Updated Jun 22 • 7.6k • 39

AnkitAI/Parable-Qwen3-4B-Claude-Fable-5-GGUF

Text Generation • 4B • Updated 27 days ago • 480k • 17

divinetribe/Hermes-4-14B-abliterated-4bit-mlx

Text Generation • 15B • Updated 15 days ago • 1.33k • 3

m15dg/local-ai-toolkit

Text Generation • 35B • Updated Jul 18 • 6.97k • 34

FINAL-Bench/POCKET-35B-GGUF

Text Generation • 35B • Updated Jul 29 • 720k • 72

FINAL-Bench/POCKET-26B-GGUF

Text Generation • 25B • Updated Jul 29 • 321k • 48

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-v3-GGUF

Text Generation • 1B • Updated Jul 29 • 943 • 6

playn4/playnfrontierAI

Updated 3 days ago • 1

McaTech/Nonet

Text Generation • 0.1B • Updated Jun 30, 2025 • 275 • 3

seasparks/Llama-3.1-8B-Instruct-LegalCite-gguf

Text Generation • 8B • Updated Apr 7, 2025 • 28

umar141/gemma-3-Baro-finetune-v2-gguf

4B • Updated Apr 13, 2025 • 17 • 1

umar141/gemma-3-Baro-finetune-v3-gguf

4B • Updated Apr 17, 2025 • 95

dwili/gemma3-1b-ringkasan-bahasa-indo-gguf

1.0B • Updated Jun 29, 2025 • 25 • 1

Hussain2050/GGUF-Loader

Updated Feb 7 • 1

shiv1119/ollama-model-shiv

Text Generation • Updated Jul 23, 2025

hedachi/LLM_Battle

Updated Aug 18, 2025 • 6

gpsworld/gpsworld

Text Generation • 3B • Updated Sep 2, 2025 • 1

neuralcrew/neutrino-instruct

Text Generation • 7B • Updated Jul 17 • 36.4k • 7

Manojb/Qwen3-4B-toolcalling-gguf-codex

Text Generation • 4B • Updated Sep 21, 2025 • 2.68k • 55

Manojb/Qwen-7B-toolcalling-ReSearch-gguf-Q8_0-codex

Text Generation • 8B • Updated Sep 21, 2025 • 274 • 2

Manojb/Qwen3-4b-toolcall-gguf-llamacpp-codex

Text Generation • 4B • Updated Sep 25, 2025 • 913 • 9

Daizee/Luna-Gemma3-4b-GGUFs

4B • Updated Oct 27, 2025 • 64

AndriLawrence/Qwen-3B-Intent-Microplan-v1

Text Generation • 3B • Updated Nov 5, 2025 • 48