Instructions to use xayrullonematov/hamma-gemma-4-devops-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16 # Run inference directly in the terminal: llama cli -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16 # Run inference directly in the terminal: llama cli -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16 # Run inference directly in the terminal: ./build/bin/llama cli -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Use Docker
docker model run hf.co/xayrullonematov/hamma-gemma-4-devops-GGUF:F16
- Llama new
- LM Studio
- Jan
- Ollama
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with Ollama:
ollama run hf.co/xayrullonematov/hamma-gemma-4-devops-GGUF:F16
- Unsloth Desktop
- Pi
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "xayrullonematov/hamma-gemma-4-devops-GGUF:F16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with Docker Model Runner:
docker model run hf.co/xayrullonematov/hamma-gemma-4-devops-GGUF:F16
- Lemonade
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Run and chat with the model
lemonade run user.hamma-gemma-4-devops-GGUF-F16
List all available models
lemonade list
- Hermes Agent
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use xayrullonematov/hamma-gemma-4-devops-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf xayrullonematov/hamma-gemma-4-devops-GGUF:F16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "xayrullonematov/hamma-gemma-4-devops-GGUF:F16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
HAMMA DevOps AI (Gemma 4 Q4_K_M) โฌโฌ
This is a specialized, locally-running DevOps and Sysadmin AI, fine-tuned specifically to diagnose and resolve Linux server errors, reverse proxy (Nginx) crashes, and common deployment bottlenecks.
This model serves as the core intelligence engine for HAMMA, an offline, Zero-Install SSH and SFTP client featuring a geometric brutalist interface. It was created as an official submission for the Gemma 4 Good Hackathon.
๐ง Model Details
- Base Model:
unsloth/gemma-4-e4b-it-bnb-4bit - Architecture: Gemma 4 (Text-only, 8B parameters)
- Quantization:
Q4_K_M(4-bit, highly optimized for standard laptop hardware) - File Size: 5.34 GB (Requires ~5.5GB to 6GB RAM to run natively)
- License: Gemma License
๐ฏ Intended Use & Out-of-Scope
Intended Use: - Assisting developers with Linux server troubleshooting (Ubuntu/Debian focused).
- Generating rapid, accurate terminal commands for system administration (e.g., port management, SSH configuration, Docker container debugging).
- Running entirely offline in low-connectivity environments to preserve maximum data privacy.
Out-of-Scope:
- General conversational chat or creative writing.
- Writing full application source code from scratch.
- Acting as a substitute for human oversight in production environments (always verify commands before execution).
๐ Training Data & Methodology
The model was fine-tuned to prioritize direct, action-oriented terminal commands over conversational padding.
- Dataset: Fine-tuned on a custom, curated dataset of 1,500+ problem-solution pairs. The data was synthesized from standard Ubuntu sysadmin man pages, Nginx documentation, and common systemd failure states, specifically formatted to enforce zero-fluff responses.
- Fine-Tuning Framework: LoRA (Low-Rank Adaptation) using Unsloth.
- Hyperparameters: - LoRA Rank ($r$): 16
- LoRA Alpha ($\alpha$): 32
- Target Modules:
q_proj,k_proj,v_proj,o_proj,gate_proj,up_proj,down_proj - Epochs: 1 (Note: A single epoch was strictly sufficient to enforce the desired CLI-output format given the highly narrow task domain, preventing overfitting on the specific synthetic log errors).
โ ๏ธ Limitations & Bias
- Destructive Commands: While the model is trained to fix errors, users must exercise caution. The model may occasionally suggest aggressive fixes (e.g.,
kill -9or recursivermcommands) if prompted carelessly. - Context Blindness: The AI does not know your specific server's custom configuration or architecture unless explicitly provided in the prompt.
- Hallucination: Like all LLMs, it can occasionally hallucinate flags for obscure CLI tools.
๐ Evaluation
During informal benchmarking against 50 common Linux sysadmin failure states (including port collisions, dead systemd services, and SSH key rejection), this fine-tuned model consistently delivered the exact resolution command.
Methodology Note: The fine-tuned HAMMA model achieved a 3x faster time-to-generate the full response compared to the base gemma-4-e4b-it model. Because the base model tends to generate paragraphs of conversational padding ("I'd be happy to help you with that error..."), our fine-tuned adapter immediately outputs the raw terminal command, drastically cutting down total inference time.
๐ป Usage (llama.cpp)
To run this model directly via the command line using llama.cpp. Note the flags: -c 4096 allocates a healthy context window for pasting large error logs, while -n 512 caps the generated response to keep the output concise.
llama-cli -m gemma-4-e4b-it.Q4_K_M.gguf -c 4096 -n 512 --prompt "Server error: 502 Bad Gateway on Nginx. Fix it."
- Downloads last month
- 199
4-bit