Instructions to use ginipick/neutts-air with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ginipick/neutts-air with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="ginipick/neutts-air",
	filename="neutss-air-BF16.gguf",
)

llm.create_chat_completion(
	messages = "\"The answer to the universe is 42\""
)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use ginipick/neutts-air with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf ginipick/neutts-air:BF16
# Run inference directly in the terminal:
llama-cli -hf ginipick/neutts-air:BF16

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf ginipick/neutts-air:BF16
# Run inference directly in the terminal:
llama-cli -hf ginipick/neutts-air:BF16

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf ginipick/neutts-air:BF16
# Run inference directly in the terminal:
./llama-cli -hf ginipick/neutts-air:BF16

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf ginipick/neutts-air:BF16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf ginipick/neutts-air:BF16

Use Docker

docker model run hf.co/ginipick/neutts-air:BF16

LM Studio
Jan
Ollama
How to use ginipick/neutts-air with Ollama:
```
ollama run hf.co/ginipick/neutts-air:BF16
```

Unsloth Studio new

How to use ginipick/neutts-air with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for ginipick/neutts-air to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for ginipick/neutts-air to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for ginipick/neutts-air to start chatting

Pi new

How to use ginipick/neutts-air with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf ginipick/neutts-air:BF16

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "ginipick/neutts-air:BF16"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use ginipick/neutts-air with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf ginipick/neutts-air:BF16

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default ginipick/neutts-air:BF16

Run Hermes

hermes

Docker Model Runner
How to use ginipick/neutts-air with Docker Model Runner:
```
docker model run hf.co/ginipick/neutts-air:BF16
```

Lemonade

How to use ginipick/neutts-air with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull ginipick/neutts-air:BF16

Run and chat with the model

lemonade run user.neutts-air-BF16

List all available models

lemonade list

NeuTTS Air ☁️

🚀 Spaces Demo, 🔧 Github

Q8 GGUF version, Q4 GGUF version

Created by Neuphonic - building faster, smaller, on-device voice AI

State-of-the-art Voice AI has been locked behind web APIs for too long. NeuTTS Air is the world’s first super-realistic, on-device, TTS speech language model with instant voice cloning. Built off a 0.5B LLM backbone, NeuTTS Air brings natural-sounding speech, real-time performance, built-in security and speaker cloning to your local device - unlocking a new category of embedded voice agents, assistants, toys, and compliance-safe apps.

Key Features

🗣Best-in-class realism for its size - produces natural, ultra-realistic voices that sound human
📱Optimised for on-device deployment - provided in GGML format, ready to run on phones, laptops, or even Raspberry Pis
👫Instant voice cloning - create your own speaker with as little as 3 seconds of audio
🚄Simple LM + codec architecture built off a 0.5B backbone - the sweet spot between speed, size, and quality for real-world applications

Websites like neutts.com are popping up and they're not affliated with Neuphonic, our github or this repo.

We are on neuphonic.com only. Please be careful out there! 🙏

Model Details

NeuTTS Air is built off Qwen 0.5B - a lightweight yet capable language model optimised for text understanding and generation - as well as a powerful combination of technologies designed for efficiency and quality:

Audio Codec: NeuCodec - our proprietary neural audio codec that achieves exceptional audio quality at low bitrates using a single codebook
Format: Available in GGML format for efficient on-device inference
Responsibility: Watermarked outputs
Inference Speed: Real-time generation on mid-range devices
Power Consumption: Optimised for mobile and embedded devices

Get Started

Clone the Git Repo

git clone https://github.com/neuphonic/neutts-air.git
cd neuttsair

Install espeak (required dependency)

Please refer to the following link for instructions on how to install espeak:

https://github.com/espeak-ng/espeak-ng/blob/master/docs/guide.md
```
# Mac OS
brew install espeak

# Ubuntu/Debian
sudo apt install espeak

# Arch Linux
paru -S aur/espeak
```
Install Python dependencies

The requirements file includes the dependencies needed to run the model with PyTorch. When using an ONNX decoder or a GGML model, some dependencies (such as PyTorch) are no longer required.

The inference is compatible and tested on python>=3.11.
```
pip install -r requirements.txt
```

Basic Example

Run the basic example script to synthesize speech:

python -m examples.basic_example \
  --input_text "My name is Dave, and um, I'm from London" \
  --ref_audio samples/dave.wav \
  --ref_text samples/dave.txt

To specify a particular model repo for the backbone or codec, add the --backbone argument. Available backbones are listed in NeuTTS-Air huggingface collection.

Several examples are available, including a Jupyter notebook in the examples folder.

Simple One-Code Block Usage

from neuttsair.neutts import NeuTTSAir
import soundfile as sf

tts = NeuTTSAir( backbone_repo="neuphonic/neutts-air-q4-gguf", backbone_device="cpu", codec_repo="neuphonic/neucodec", codec_device="cpu")
input_text = "My name is Dave, and um, I'm from London."

ref_text = "samples/dave.txt"
ref_audio_path = "samples/dave.wav"

ref_text = open(ref_text, "r").read().strip()
ref_codes = tts.encode_reference(ref_audio_path)

wav = tts.infer(input_text, ref_codes, ref_text)
sf.write("test.wav", wav, 24000)

Tips

NeuTTS Air requires two inputs:

A reference audio sample (.wav file)
A text string

The model then synthesises the text as speech in the style of the reference audio. This is what enables NeuTTS Air’s instant voice cloning capability.

Example Reference Files

You can find some ready-to-use samples in the examples folder:

samples/dave.wav
samples/jo.wav

Guidelines for Best Results

For optimal performance, reference audio samples should be:

Mono channel
16-44 kHz sample rate
3–15 seconds in length
Saved as a .wav file
Clean — minimal to no background noise
Natural, continuous speech — like a monologue or conversation, with few pauses, so the model can capture tone effectively

Responsibility

Every audio file generated by NeuTTS Air includes **Perth (Perceptual Threshold) Watermarker.**

Disclaimer

Don't use this model to do bad things… please.

Downloads last month: 27

GGUF

Model size

0.7B params

Architecture

qwen2

Hardware compatibility

16-bit

Duplicated from neuphonic/neutts-air

ginipick
/

neutts-air