oxyapi

/

oxy-1-small-GGUF

like 22

Follow

Oxygen 60

The quality obviously depends on the GGUF you have chosen, with the base model I did not encounter any repetition problems, have you tried to adjust the repetition_penalty? or use another GGUF? what can I do on my side to spot this problem?

I used a Q5KM from another person on here, and no repetition penalty or anything else as I don't really require that usually with bigger models... I'm testing again now to try and reproduce it.

It also seems to really like NOT following instructions 😅

Oh sorry for that, I never use GGUF I didn't test anything before uploading.. I can understand that you don't like the model there is no problem don't force yourself to use it if it doesn't seem to fit!

It's a promising model, I just wanted to help find what's wrong 🙁

Two other people on reddit talked about this problem, I wonder if it comes from a quants or if it's all of them that are bugged.. have you had any problems with the bartowski or mradermacher quants?

Yeah I started with mrademacher then yours and had the same issues