Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

gemma4_assistant

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

122

Base only

Active filters: gemma4_assistant

thy025/gemma-4-31B-it-assistant

Any-to-Any • 0.5B • Updated May 15 • 5

inferencerlabs/gemma-4-31B-MTP-MLX

Image-Text-to-Text • 0.5B • Updated Jun 27 • 164

inferencerlabs/gemma-4-26B-A4B-MTP-MLX

Image-Text-to-Text • 0.4B • Updated Jun 27 • 226 • 1

jahwag/gemma-4-26B-A4B-it-assistant-8bit

Updated May 25 • 14

yujiepan/gemma-4-assistant-tiny-random

Text Generation • 2.12M • Updated May 26 • 109

tiny-random/gemma-4-assistant

Text Generation • 2.12M • Updated May 26 • 24

google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 78M • Updated Jul 20 • 552 • 21

google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant

Any-to-Any • 78.8M • Updated Jul 20 • 1.08k • 15

google/gemma-4-26B-A4B-it-qat-q4_0-unquantized-assistant

Image-Text-to-Text • 0.4B • Updated Jul 20 • 5.08k • 18

google/gemma-4-31B-it-qat-q4_0-unquantized-assistant

Image-Text-to-Text • 0.5B • Updated Jul 20 • 33k • 25

Reza2kn/gemma-4-26B-A4B-it-assistant-NVFP4

Text Generation • Updated 14 days ago • 281 • 1

melcheikh/gemma-4-31B-it-qat-assistant-NVFP4-Blackwell

Text Generation • 0.4B • Updated Jun 8 • 29 • 4

mlx-community/gemma-4-E2B-it-qat-assistant-4bit

Text Generation • 78M • Updated Jun 5 • 129

mlx-community/gemma-4-E2B-it-qat-assistant-5bit

Text Generation • 78M • Updated Jun 5 • 33

mlx-community/gemma-4-E2B-it-qat-assistant-6bit

Text Generation • 78M • Updated Jun 5 • 29

mlx-community/gemma-4-E2B-it-qat-assistant-8bit

Text Generation • 78M • Updated Jun 5 • 37

mlx-community/gemma-4-E2B-it-qat-assistant-bf16

Text Generation • 78M • Updated Jun 5 • 54

mlx-community/gemma-4-E2B-it-qat-assistant-mxfp4

Text Generation • 78M • Updated Jun 5 • 89 • 1

mlx-community/gemma-4-E2B-it-qat-assistant-nvfp4

Text Generation • 78M • Updated Jun 5 • 54

mlx-community/gemma-4-E2B-it-qat-assistant-mxfp8

Text Generation • 78M • Updated Jun 5 • 34

mlx-community/gemma-4-E4B-it-qat-assistant-4bit

Text Generation • 78.8M • Updated Jun 5 • 193 • 1

mlx-community/gemma-4-E4B-it-qat-assistant-6bit

Text Generation • 78.8M • Updated Jun 5 • 42

mlx-community/gemma-4-E4B-it-qat-assistant-5bit

Text Generation • 78.8M • Updated Jun 5 • 38

mlx-community/gemma-4-E4B-it-qat-assistant-8bit

Text Generation • 78.8M • Updated Jun 5 • 90

mlx-community/gemma-4-E4B-it-qat-assistant-bf16

Text Generation • 78.8M • Updated Jun 5 • 158 • 2

mlx-community/gemma-4-E4B-it-qat-assistant-mxfp4

Text Generation • 78.8M • Updated Jun 5 • 74 • 1

mlx-community/gemma-4-E4B-it-qat-assistant-nvfp4

Text Generation • 78.8M • Updated Jun 5 • 40

mlx-community/gemma-4-E4B-it-qat-assistant-mxfp8

Text Generation • 78.8M • Updated Jun 5 • 54

mlx-community/gemma-4-26B-A4B-it-qat-assistant-4bit

Text Generation • 0.4B • Updated Jun 5 • 5.07k • 2

mlx-community/gemma-4-26B-A4B-it-qat-assistant-5bit

Text Generation • 0.4B • Updated Jun 5 • 33