When will this be availbale on llama.cpp?

#10
by Kendolph - opened

vLLM is a massive mess and an absolute hassle to deal with and I don't want to get back to that thing.
When will this awesome sounding model be available for llama.cpp? 😁

Same to you, I hope this open model can be loaded with llama.cpp

yeah 100%

There is an ongoing effort for llama.cpp integration here

Sign up or log in to comment