RedHatAI/gemma-4-31B-it-NVFP4
Image-Text-to-Text • 20B • Updated • 188k • 41
Edit Models filters
Apps
Inference Providers
Active filters: llm-compressor
RedHatAI/gemma-4-31B-it-FP8-block
Image-Text-to-Text • 31B • Updated • 252k • 26
plezan/Mistral-Medium-3.5-128B-W4A16
Image-Text-to-Text • 22B • Updated • 12.6k • 3
RedHatAI/Phi-4-mini-instruct-FP8-dynamic
Text Generation • 4B • Updated • 377 • 1
mratsim/MiniMax-M2.5-BF16-INT4-AWQ
Text Generation • 39B • Updated • 7.28k • 39
ebircak/gemma-4-31B-it-4bit-W4A16-GPTQ
Text Generation • 32B • Updated • 21.8k • 3
ebircak/gemma-4-31B-it-4bit-W4A16-AWQ
Text Generation • Updated • 13.7k • 1
Hyun9junn/K-EXAONE-236B-A23B-W4A16-G128
Text Generation • 33B • Updated • 447 • 1
RedHatAI/Qwen3.5-9B-quantized.w4a16
Image-Text-to-Text • 9B • Updated • 406 • 1
zdy1995love/Mistral-Medium-3.5-128B-NVFP4
Text Generation • 74B • Updated • 10.7k • 3
qmxme/Qwen3.6-27B-NVFP4
Text Generation • 10B • Updated • 364 • 1
RedHatAI/Qwen3.5-9B-FP8-dynamic
Image-Text-to-Text • 9B • Updated • 539 • 1
RedHatAI/Qwen2.5-0.5B-quantized.w8a16
Text Generation • 0.4B • Updated • 14
RedHatAI/Qwen2.5-1.5B-quantized.w8a16
Text Generation • 0.8B • Updated • 53
RedHatAI/Qwen2.5-3B-quantized.w8a16
Text Generation • 1B • Updated • 22
RedHatAI/Qwen2.5-7B-quantized.w8a16
Text Generation • 3B • Updated • 15 • 1
RedHatAI/Qwen2.5-32B-quantized.w8a16
Text Generation • 9B • Updated • 17
RedHatAI/Qwen2.5-72B-quantized.w8a16
Text Generation • 20B • Updated • 18
RedHatAI/Qwen2.5-Coder-14B-Instruct-FP8-dynamic
Text Generation • 15B • Updated • 446 • 1
jsbaicenter/r1-1776-distill-llama-70b-FP8-Dynamic
Text Generation • 71B • Updated • 2 • 1
divish/M-Prometheus-3B-FP8-Dynamic
Text Generation • 3B • Updated • 6
textgeflecht/Devstral-Small-2505-FP8-llmcompressor
Text Generation • 24B • Updated • 3
ConfidentialMind/InternVL3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 91 • 2
textgeflecht/Qwen2.5-Coder-32B-Instruct-FP8-dynamic
Text Generation • 33B • Updated • 52
brandonbeiler/InternVL3-38B-FP8-Dynamic
Image-Text-to-Text • 38B • Updated • 9
brandonbeiler/InternVL3-78B-FP8-Dynamic
Image-Text-to-Text • 78B • Updated • 39
brandonbeiler/InternVL3-8B-FP8-Dynamic
Image-Text-to-Text • 8B • Updated • 21 • 2
RedHatAI/Qwen3-30B-A3B-FP8-block
Text Generation • 31B • Updated • 14.5k
JustJaro/SmolLM-135M-FP8-Static
Image-Text-to-Text • 0.2B • Updated • 13
JustJaro/SmolLM-135M-FP8-Dynamic-Test
Image-Text-to-Text • 0.1B • Updated • 11