I want to make GPTQ quants but GTPQModel doesn't support VL version of Gemma. It will be awesome if you disclose your code or guide to do such things.
· Sign up or log in to comment
