Instructions to use froggeric/Qwen-Fixed-Chat-Templates with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use froggeric/Qwen-Fixed-Chat-Templates with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Qwen-Fixed-Chat-Templates froggeric/Qwen-Fixed-Chat-Templates
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
This solved sudden template error 400 with Ornith 1.0 35B with llama.cpp
#61
by troed - opened
No idea why I suddenly got those errors (did recompile llama cpp to a newer version) but adding your template fixed it. Many thanks.
Happy to hear it resolved the 400 errors on your llama.cpp build. Closing this thread.
froggeric changed discussion status to closed