Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,992

Base only

Active filters: exl3

turboderp/Mistral-Large-Instruct-2411-exl3

Updated Nov 1, 2025 • 38 • 10

MikeRoz/mistralai_Mistral-Large-Instruct-2411-8.0bpw-h8-exl3

62B • Updated Apr 8, 2025 • 11

MikeRoz/Meta-Llama-3.1-405B-Instruct-2.0bpw-h4-exl3

Text Generation • 53B • Updated Apr 9, 2025 • 8 • 1

async0x42/QwQ-32B-abliterated-exl3_4.5bpw

Text Generation • 10B • Updated Apr 10, 2025 • 11 • 1

bullerwins/Llama-3.3-70B-Instruct-exl3-4.58bpw

Text Generation • 21B • Updated Apr 10, 2025 • 10

bullerwins/Llama-3.3-70B-Instruct-exl3-4.03bpw

Text Generation • 19B • Updated Apr 10, 2025 • 10

Jellon/Lyra-Gutenberg-12b-exl3-6bpw

Text Generation • 5B • Updated Apr 10, 2025 • 14 • 1

Jellon/Lyra-Gutenberg-12b-exl3-4bpw

Text Generation • 4B • Updated Apr 10, 2025 • 4

Volko76/Llama-3.2-1B-Instruct-exl3

0.6B • Updated Apr 10, 2025 • 4

Volko76/Qwen2.5-Coder-0.5B-Instruct-exl3

Text Generation • 0.3B • Updated Apr 10, 2025 • 20 • 1

Volko76/Lucie-7B-Instruct-abliterated-exl3

2B • Updated Apr 10, 2025 • 3

async0x42/cogito-v1-preview-qwen-32B-exl3_4.5bpw

Text Generation • 10B • Updated Apr 11, 2025 • 3

async0x42/DeepCoder-1.5B-Preview-exl3_4.5bpw

Text Generation • 0.7B • Updated Apr 11, 2025 • 3

async0x42/QwQ-32B-Snowdrop-v0-exl3_4.5bpw

Text Generation • 10B • Updated Aug 3, 2025 • 10

async0x42/QwQ-32B-ArliAI-RpR-v1-exl3_4.5bpw

10B • Updated Apr 11, 2025 • 9 • 1

Jellon/Pantheon-RP-1.8-24b-Small-3.1-exl3-4bpw

6B • Updated Apr 12, 2025 • 4 • 1

Jellon/Pantheon-RP-1.8-24b-Small-3.1-exl3-3bpw

5B • Updated Apr 12, 2025 • 6 • 1

kaitchup/Llama-3.3-70B-Instruct-exl3-1.75bpw

Text Generation • 9B • Updated Apr 12, 2025 • 4

kaitchup/Llama-3.3-70B-Instruct-exl3-4.0bpw

Text Generation • 19B • Updated Apr 12, 2025 • 13 • 1

Jellon/QwQ-32B-exl3-4bpw

Text Generation • 9B • Updated Apr 12, 2025 • 6 • 2

ThijsL202/Pantheon-RP-1.8-24b-Small-3.1-exl3-6.0bpw

9B • Updated Apr 15, 2025 • 6

turboderp/Llama-3.1-Nemotron-Ultra-253B-v1-exl3

Updated Nov 1, 2025 • 5 • 5

turboderp/Llama-3.3-Nemotron-Super-49B-v1-exl3

Updated Nov 1, 2025 • 56 • 17

ArtusDev/nvidia_Llama-3_1-Nemotron-Ultra-253B-v1_EXL3_1.35bpw_H6

Text Generation • 24B • Updated May 14, 2025 • 3

MikeRoz/Mistral-Large-Instruct-2407-exl3

Updated Apr 17, 2025 • 72 • 2

gghfez/L3.3-San-Mai-R1-70b-exl3-2.1bpw

Text Generation • 10B • Updated Apr 15, 2025 • 4

MikeRoz/Electranova-70B-v1.0-exl3

Updated Sep 29, 2025

isogen/reka-flash-3-exl3-3bpw

5B • Updated Jun 22, 2025

LatentWanderer/THUDM_GLM-4-32B-0414-6.5bpw-h8-exl3

Text Generation • 14B • Updated Apr 22, 2025 • 9

isogen/reka-flash-3-exl3-4bpw

6B • Updated Jun 22, 2025 • 2