How to use from
PiConfigure the model in Pi
# Install Pi:
npm install -g @mariozechner/pi-coding-agent# Add to ~/.pi/agent/models.json:
{
"providers": {
"mlx-lm": {
"baseUrl": "http://localhost:8080/v1",
"api": "openai-completions",
"apiKey": "none",
"models": [
{
"id": "mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit"
}
]
}
}
}Run Pi
# Start Pi in your project directory:
piQuick Links
mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit
This model mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit was converted to MLX format from Qwen/Qwen3-Coder-30B-A3B-Instruct using mlx-lm version 0.26.1.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit")
prompt = "hello"
if tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Downloads last month
- 365
Hardware compatibility
Log In to add your hardware
5-bit
Model tree for mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit
Base model
Qwen/Qwen3-Coder-30B-A3B-Instruct
Start the MLX server
# Install MLX LM: uv tool install mlx-lm# Start a local OpenAI-compatible server: mlx_lm.server --model "mlx-community/Qwen3-Coder-30B-A3B-Instruct-5bit"