Quantizations of the model: - https://huggingface.co/TehVenom/Pygmalion-13b-Merged Under the following versions: - Q4_1 (4bit); - Q5_1 (5bit); - Q8_0 (8bit).