Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,229

Base only

Active filters: mixtral

Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-3-experts

Text Generation • 30B • Updated Oct 6, 2024 • 7

Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-2-experts

Text Generation • 35B • Updated Oct 6, 2024 • 8

Na0s/Mixtral-8x7B-v0.1-instruct-pruned-random-1-experts

Text Generation • 41B • Updated Oct 6, 2024 • 12

Treza12/PlanB-1

35B • Updated Oct 6, 2024 • 6

lurker18/Mixtral_8x7B_v0.1_AWQ_4bit

47B • Updated Oct 7, 2024 • 5

liorsadan/Mixtral-8x7B-Instruct-v0.1.0.0.23

Updated Oct 7, 2024 • 5

liorsadan/Mixtral-8x7B-Instruct-v0.1

Updated Oct 8, 2024 • 5

yifeihe3/phi_moe_top_2

Text Generation • 42B • Updated Oct 8, 2024 • 8

yifeihe3/phi_moe_top_1

Text Generation • 42B • Updated Oct 8, 2024 • 8

yifeihe3/phi_moe_separate_lora

Text Generation • 42B • Updated Oct 9, 2024 • 7

yifeihe3/phi_moe_lora

Text Generation • 42B • Updated Oct 9, 2024 • 7

yifeihe3/phi_moe_top_4

Text Generation • 42B • Updated Oct 9, 2024 • 9

yifeihe3/phi_moe_top_8

Text Generation • 42B • Updated Oct 9, 2024 • 10

CalamitousFelicitousness/SorcererLM-8x22b-exl2-longcal-exl2-4.5bpw

Updated Oct 9, 2024 • 4

CalamitousFelicitousness/SorcererLM-8x22b-exl2-longcal-exl2-8.0bpw

Text Generation • Updated Oct 9, 2024 • 9

Gunulhona/Mitral-MoE-Merge

58B • Updated Oct 10, 2024 • 7

mlx-community/karakuri-lm-8x7b-chat-v0.1

Text Generation • 47B • Updated Oct 11, 2024 • 15

mlx-community/karakuri-lm-8x7b-chat-v0.1-4bit

Text Generation • 7B • Updated Oct 11, 2024 • 15

mlx-community/karakuri-lm-8x7b-instruct-v0.1

Text Generation • 47B • Updated Oct 11, 2024 • 18

mlx-community/karakuri-lm-8x7b-instruct-v0.1-8bit

Text Generation • 13B • Updated Oct 11, 2024 • 11

mlx-community/karakuri-lm-8x7b-instruct-v0.1-4bit

Text Generation • 7B • Updated Oct 11, 2024 • 18

DBMe/WizardLM-2-8x22B-2.6bpw-h6-exl2

Updated Oct 21, 2024 • 5

mradermacher/karakuri-lm-8x7b-chat-v0.1-GGUF

47B • Updated Oct 14, 2024 • 114

UNSAFE/Mixtress-135M

0.1B • Updated Oct 13, 2024 • 8

mradermacher/karakuri-lm-8x7b-instruct-v0.1-GGUF

47B • Updated Oct 14, 2024 • 297

mlx-community/SorcererLM-8x22b-8bit

40B • Updated Oct 14, 2024 • 11

mlx-community/SorcererLM-8x22b-4bit

22B • Updated Oct 14, 2024 • 10

mlx-community/SorcererLM-8x22b-2bit

13B • Updated Oct 14, 2024 • 9

mradermacher/karakuri-lm-8x7b-instruct-v0.1-i1-GGUF

47B • Updated Oct 14, 2024 • 828

mradermacher/karakuri-lm-8x7b-chat-v0.1-i1-GGUF

47B • Updated Oct 15, 2024 • 445