Configuration Parsing Warning:Config file tokenizer_config.json cannot be fetched (too big)

AWQ-Marlin Quantization Model

This model is based on the AWQ-Marlin quantization technique and is optimized for role-playing scenarios. It has been trained to generate dialogue and interactions in text-based RPGs. The model provides efficient performance without compromising on quality.

Use Cases

Role-playing Games (RPGs): Generate character dialogues and plot interactions in text-based RPGs.

Downloads last month: 13

Safetensors

Model size

8B params

Tensor type

I32

F16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support