Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,225

Base only

Active filters: int8

transformerlab/ideogram-4-int8-w8a8

Text-to-Image • Updated 3 days ago • 6

nameistoken/Qwen3.6-27B-Quark-W8A8-INT8

Image-Text-to-Text • 27B • Updated about 1 month ago • 3.86k • 6

vistralis/FLUX.2-klein-9b-INT8-transformer

Text-to-Image • Updated Feb 16 • 467 • 3

EricRollei/HunyuanImage-3.0-Instruct-Distil-INT8-v2

Text-to-Image • 83B • Updated Feb 22 • 82 • 7

smcleod/cohere-transcribe-03-2026-int8

Automatic Speech Recognition • Updated Apr 13 • 3

aufklarer/Kokoro-82M-CoreML-INT8

Text-to-Speech • Updated Apr 19 • 100 • 1

nameistoken/Gemma-4-31B-it-Quark-W8A8-INT8

Image-Text-to-Text • 31B • Updated Apr 23 • 663 • 3

curiositytech/runeward-small-onnx-int8

Token Classification • Updated May 11 • 10 • 2

Abiray/L2P-model-1k-merge-INT8

Text-to-Image • Updated 20 days ago • 13

veyra-ai/Kairo-5M-Gemma4-Base-ONNX-Int8

Text Generation • Updated 5 days ago • 56 • 1

veyra-ai/Veyra2-30M-Instruct-Early-ONNX-Int8

Text Generation • 34.6M • Updated 17 days ago • 5 • 1

trsdn/parakeet-tdt-0.6b-v3-htp-int8-8s

Automatic Speech Recognition • Updated 20 minutes ago • 1

hadiyarajesh/indicconformer-hi-int8-onnx

Automatic Speech Recognition • Updated 8 days ago • 1

bartsolutions/DeepSeek-OCR-2-GPTQ-INT8

Image-Text-to-Text • 3B • Updated 7 days ago • 406 • 1

smcleod/nemotron-3.5-asr-streaming-0.6b-int8

Automatic Speech Recognition • Updated 5 days ago • 27 • 1

LLM-OS-Models/KoHRM-Text-1.4B-CPU-Runtime

Updated 3 days ago • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 112 • 6

INC4AI/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 14 • 1

INC4AI/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 11

INC4AI/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 48

INC4AI/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 12

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 66

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 8 • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 672 • 1

INC4AI/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 30 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 482 • 5

INC4AI/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 10 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Updated Mar 21, 2024 • 502 • 1

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 8

echarlaix/vit-food101-int8

Image Classification • Updated Nov 22, 2022 • 6