moonshotai/Kimi-K2.5
#16
by
gghfez - opened
I checked the unloth quant, and it's Q4_K, so a lossy conversion from the original INT4. Waiting for your Q4_X quant!
Sorry for slow response, life has been busy and I'll not be fully back in the saddle until end of this week.
AesSedai released the "full quality" Kimi-K2.5 Q4_X which if you want the best, that is it.
I'll look into possibly smaller quants later too given it quantizes quite well just over 3bpw-ish!
<3 u guys and big hugs for everyone as life can be crazy somtimes haha... Cheers!
Sorry for slow response, life has been busy and I'll not be fully back in the saddle until end of this week.
No need to apologize mate, I was just sharing the hype lol
We appreciate the quants whenever they happen, but take care of yourself first!