Quantization request for https://huggingface.co/hon9kon9ize/CantoneseLLM-v2.0-8B-Thinking-Chat-Vector-Merged
#2891
by gluestick53A - opened
Please consider creating GGUF and imatrix quants for https://huggingface.co/hon9kon9ize/CantoneseLLM-v2.0-8B-Thinking-Chat-Vector-Merged
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#CantoneseLLM-v2.0-8B-Thinking-Chat-Vector-Merged-GGUF for quants to appear.