censored
nothing unexpected from a gemma base, but i don't really see the appeal of philosophical discussion with a model that pushes morality.
Hmm, that's an interesting point. I'm curious what you asked it that it refused XD
Alright, I'll train one on an abliterated base. I am curious to see what happens to model's alignment when ablated and then given a new philosophical system.
Do you have a model size that you would like to see? Should I just do the gemma 4 12b again or something different?
Unfortunately that's between me and SillyTavern :) But I tried a heretic lora today and it still wouldn't budge. I can't run 31b at high enough quant to truly appreciate them, so 26b would be nice, but 12b is just fine if MoEs have something extra finnicky going on. Personally I am a Magistral appreciator but I know they've been surpassed by gemma4 in smarts.