Hugging Face's logo

gghfez
/
DeepSeek-R1-0528-IQ3_KS

GGUF
imatrix
conversational
Model card Files
xet
 Community
How to use from
llama.cpp
Install (macOS, Linux) 
curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf gghfez/DeepSeek-R1-0528-IQ3_KS
# Run inference directly in the terminal:
llama cli -hf gghfez/DeepSeek-R1-0528-IQ3_KS
Install from WinGet (Windows) 
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf gghfez/DeepSeek-R1-0528-IQ3_KS
# Run inference directly in the terminal:
llama cli -hf gghfez/DeepSeek-R1-0528-IQ3_KS
Build from source code 
git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf gghfez/DeepSeek-R1-0528-IQ3_KS
# Run inference directly in the terminal:
./build/bin/llama cli -hf gghfez/DeepSeek-R1-0528-IQ3_KS
Use Docker 
docker model run hf.co/gghfez/DeepSeek-R1-0528-IQ3_KS
Quick Links

No model card

Downloads last month
54
GGUF
Model size
672B params
Architecture
deepseek2
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including gghfez/DeepSeek-R1-0528-IQ3_KS