Hugging Face's logo
Stephen Moore's picture
Open to Collab
21 39 178

Stephen Moore

shootstuff
RFTSystems's profile picture CYGDEN's profile picture Felipe2231's profile picture
·

AI & ML interests

None yet

Recent Activity

updated a collection about 7 hours ago
Models
liked a model about 7 hours ago
dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw
reacted to bartowski's post with ❤️ about 8 hours ago
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :') https://huggingface.co/bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there) Outlined the details of the script and results in my llama.cpp PR to add the jinja template: https://github.com/ggml-org/llama.cpp/pull/14349 Start server with a command like this: ``` ./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinja ``` and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
View all activity

Organizations

AI FILMS's profile picture TorchGeo's profile picture Stable Diffusion Dreambooth Concepts Library's profile picture Seoul National University of Science and Technology's profile picture Multi🤖Transformers's profile picture Hugging Face Discord Community's profile picture University of California, Berkeley's profile picture Dataset Tools's profile picture None yet's profile picture LiteRT Community (FKA TFLite)'s profile picture Hugging Face MCP Course's profile picture Agents-MCP-Hackathon's profile picture OpenFree_AI's profile picture XORTRON - Criminal Computing's profile picture DataMuncher Labs's profile picture