Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,311

Base only

Active filters: GGUF

tsunemoto/Metis-0.4-GGUF

7B • Updated Dec 19, 2023 • 52

LiteLLMs/Mistral-7B-Merge-14-v0.1-GGUF

Text Generation • 7B • Updated Jan 24, 2024 • 1.12k

tsunemoto/Nous-Hermes-2-Yi-34B-GGUF

34B • Updated Dec 26, 2023 • 261 • 1

andrijdavid/Mistral-T5-7B-v1-GGUF

Text Generation • Updated Dec 27, 2023 • 10

andrijdavid/Marcoroni-7B-v3-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 248

andrijdavid/mindy-7b-v2-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 167

andrijdavid/supermario-v2-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 146

andrijdavid/CatPPT-base-GGUF

Text Generation • 7B • Updated Dec 27, 2023 • 200 • 1

andrijdavid/LMCocktail-10.7B-v1-GGUF

Text Generation • 11B • Updated Dec 27, 2023 • 137 • 1

andrijdavid/Sakura-SOLAR-Instruct-GGUF

Text Generation • 11B • Updated Dec 28, 2023 • 126 • 1

tsunemoto/TinyLlama-1.1B-Chat-v0.6-x8-MoE-GGUF

6B • Updated Dec 29, 2023 • 557 • 6

mozilla-ai/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 6, 2025 • 18.5k • 15

andrijdavid/CarbonVillain-en-10.7B-v2-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 147

andrijdavid/StopCarbon-10.7B-v5-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 177 • 1

LiteLLMs/CarbonVillain-en-10.7B-v3-GGUF

Text Generation • 11B • Updated Jan 1, 2024 • 163

yargpt/vicuna-13b-v1.5-gguf

Text Generation • 13B • Updated Jan 2, 2024 • 11 • 1

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Jan 19, 2024 • 696 • 2

andrijdavid/finance-chat-GGUF

Text Generation • 7B • Updated Jan 19, 2024 • 200 • 4

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 194

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 895 • 3

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • 1B • Updated Jan 2, 2024 • 115

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • 3B • Updated Jan 2, 2024 • 202

Trelis/Tiny

Text Generation • 1B • Updated Feb 22, 2024 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

47B • Updated Jan 4, 2024 • 467

rabil/TinyLlama-1.1B-Chat-v1.0-llamafile

Updated Jan 4, 2024 • 123

tsunemoto/Norobara-ZLoss-8x7B-GGUF

47B • Updated Jan 5, 2024 • 395

rabil/deepseek-coder-6.7b-instruct-llamafile

Updated Jan 5, 2024 • 35 • 3

rabil/dolphin-2_6-phi-2-llamafile

Updated Jan 7, 2024 • 63

tsunemoto/LiteLlama-460M-1T-GGUF

0.5B • Updated Jan 7, 2024 • 282 • 6

rabil/openchat-3.5-0106-llamafile

Updated Jan 11, 2024 • 59