Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

torchao-my-repo

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

47

Base only

Active filters: torchao-my-repo

medmekk/Llama-3.2-1B-ao-int8wo

Text Generation • Updated Mar 31, 2025 • 1

medmekk/Llama-3.2-1B-ao-int8da8w

Text Generation • Updated Mar 31, 2025

medmekk/Llama-3.2-1B-ao-int8wo-gs16

Text Generation • Updated Mar 31, 2025 • 1

medmekk/Llama-3.2-1B-ao-int8wo-gs32

Text Generation • Updated Mar 31, 2025 • 4

medmekk/Qwen2.5-0.5B-Instruct-ao-int8wo-gs128

Text Generation • Updated Mar 31, 2025 • 1

medmekk/Qwen2.5-0.5B-Instruct-ao-int8da8w

Text Generation • Updated Mar 31, 2025 • 5

Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int4wo-gs128

Text Generation • Updated Apr 5, 2025 • 45

Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int8wo-gs128

Text Generation • Updated Apr 5, 2025 • 48

Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int8da8w

Text Generation • Updated Apr 16, 2025 • 181 • 1

medmekk/Llama-3.2-1B-ao-float8wo

Text Generation • Updated Apr 22, 2025

medmekk/Llama-3.2-1B-ao-float8da8w

Text Generation • Updated Apr 22, 2025 • 1

medmekk/Llama-3.2-1B-ao-autoquant-1

Text Generation • Updated Apr 22, 2025

medmekk/Llama-3.2-1B-ao-float8wo-2

Text Generation • Updated Apr 22, 2025 • 1

medmekk/Llama-3.2-1B-ao-float8wo-3

Text Generation • Updated Apr 22, 2025

medmekk/Llama-3.2-1B-ao-int8wo-gs256

Text Generation • Updated Apr 22, 2025

medmekk/Llama-3.2-1B-ao-int4wo-gs128

Text Generation • Updated Apr 22, 2025 • 3

medmekk/Qwen2.5-0.5B-Instruct-ao-float8wo

Text Generation • Updated Apr 22, 2025 • 6

medmekk/Llama-3.2-1B-ao-int4wo-gs256

Text Generation • Updated Apr 22, 2025

medmekk/Llama-3.1-8B-Instruct-ao-int8wo

Text Generation • Updated Apr 24, 2025 • 2

medmekk/Llama-3.1-8B-Instruct-ao-autoquant

Text Generation • Updated Apr 24, 2025 • 3

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs128

Text Generation • Updated Apr 24, 2025 • 2

medmekk/Llama-3.1-8B-Instruct-ao-float8wo

Text Generation • Updated Apr 24, 2025 • 2

medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8

Text Generation • Updated Apr 24, 2025

medmekk/Llama-3.1-8B-Instruct-ao-int8da8w8

Text Generation • Updated Apr 24, 2025 • 1

medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8-2

Text Generation • Updated Apr 24, 2025 • 2

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs32

Text Generation • Updated Apr 24, 2025 • 1

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs16

Text Generation • Updated Apr 24, 2025 • 3

irresistiblegrace97/tinyllama.gguf

Updated Apr 24, 2025 • 1

andysalerno/Qwen3-8B-ao-autoquant

Text Generation • Updated May 9, 2025 • 1

CJHauser/vibrance

Updated May 14, 2025