Hugging Face's logo

noctrex
/
Huihui-Qwen3-VL-2B-Thinking-abliterated-GGUF

Image-Text-to-Text
GGUF
conversational
Model card Files
xet
Community

These are quantizations of the model Huihui-Qwen3-VL-2B-Thinking-abliterated.

These quantizations were created using an imatrix merged from combined_all_large and harmful.txt to leverage the abliterated nature of the model.

Usage Notes:

  • Download the latest llama.cpp to use these quantizations.
  • Try to use the best quality you can run.
  • For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).
Downloads last month
609
GGUF
Model size
2B params
Architecture
qwen3vl
Hardware compatibility
Log In to add your hardware

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

32-bit

View +1 variant
Inference Providers NEW
Image-Text-to-Text
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for noctrex/Huihui-Qwen3-VL-2B-Thinking-abliterated-GGUF

Base model

Qwen/Qwen3-VL-2B-Thinking
Finetuned
huihui-ai/Huihui-Qwen3-VL-2B-Thinking-abliterated
Quantized
(3)
this model

Collections including noctrex/Huihui-Qwen3-VL-2B-Thinking-abliterated-GGUF