Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

411

Base only

Active filters: fp16

Fulstac/deepseek-r1-Distill-Qwen-32B-lora-4bit-v3

Text Generation • 33B • Updated Jun 6, 2025 • 5

yehiazak/whisper-largev3-medical

Automatic Speech Recognition • 2B • Updated Jul 12, 2025 • 17 • 8

liuming9157/Wan2.1-T2V-1.3B-Diffusers-ov-fp16

Text-to-Video • Updated Jul 11, 2025 • 2

Mostafa8Mehrabi/qwen3-50m-storyteller

Text Generation • 71.6M • Updated Jul 11, 2025 • 15

Mostafa8Mehrabi/qwen3-50m-fp16

Text Generation • 71.6M • Updated Jul 11, 2025 • 38 • 1

ysdede/parakeet-tdt-0.6b-v2-onnx

Automatic Speech Recognition • Updated Mar 14 • 21 • 2

Mostafa8Mehrabi/qwen3-50m-c4-final-test-version

Text Generation • 71.6M • Updated Jul 11, 2025 • 5

mradermacher/qwen3-50m-storyteller-GGUF

71.6M • Updated Jul 12, 2025 • 144

Mostafa8Mehrabi/qwen3-50m-c4-final_test_H200

Text Generation • 71.6M • Updated Jul 12, 2025 • 10

Mostafa8Mehrabi/qwen3-71M-c4-final

Text Generation • 71.6M • Updated Jul 13, 2025 • 22

Mostafa8Mehrabi/qwen3-30m-fp16

Text Generation • 34.7M • Updated Jul 13, 2025 • 20

Mostafa8Mehrabi/qwen3-30m-tinystories-final

Text Generation • 34.7M • Updated Jul 14, 2025 • 6

olib-ai/whisper-to-oliver-fp16

Automatic Speech Recognition • 0.8B • Updated Jul 28, 2025 • 3

Rostlab/prot-t5-xl-uniref50-enc-onnx

Updated Jul 27, 2025 • 5

ussoewwin/WAN2.2_14B_GGUF

Image-to-Video • 14B • Updated Aug 1, 2025 • 151 • 2

ussoewwin/Wan2.2_T2V_A14B_VACE-test_fp16_GGUF

Text-to-Video • 17B • Updated Aug 21, 2025 • 73 • 1

bubblspace/Timecapsule2.7B-g3n-mix-match-gguf

6B • Updated Aug 6, 2025 • 5 • 1

twhitworth/gpt-oss-120b-fp16

Text Generation • 117B • Updated Aug 20, 2025 • 48

ussoewwin/FakeVace2.2_fp16_GGUF

Text-to-Video • 17B • Updated Aug 22, 2025 • 11

mradermacher/svg-code-generator-GGUF

0.6B • Updated Sep 9, 2025 • 68

mradermacher/svg-code-generator-i1-GGUF

0.6B • Updated Dec 31, 2025 • 176 • 1

Amirhossein75/Sequence2Sequence-Transformer-Translation-Opus-MT

Translation • 77.5M • Updated Sep 14, 2025 • 3

vito95311/Qwen3-Omni-30B-A3B-Thinking-INT8FP16

Text Generation • 32B • Updated Sep 24, 2025 • 78 • 6

vito95311/Qwen3-Omni-30B-A3B-Thinking-GGUF-INT8FP16

Text Generation • 16B • Updated Sep 28, 2025 • 395 • 19

wangkanai/flux-dev-fp16

Text-to-Image • Updated Oct 28, 2025 • 7

wangkanai/sdxl-fp16-loras

Text-to-Image • Updated Oct 28, 2025 • 2

wangkanai/sdxl-fp16-loras-nsfw

Text-to-Image • Updated Oct 14, 2025 • 7

wangkanai/wan22-fp16-i2v

Image-to-Video • Updated Oct 27, 2025 • 4

wangkanai/wan25-fp16-i2v-loras-nsfw

Image-to-Video • Updated Oct 28, 2025 • 27

Jesteban247/yolo11-blood_cell-onnx

Object Detection • Updated Oct 23, 2025