Hugging Face's logo

legraphista
/
Qwen2-Math-72B-Instruct-IMat-GGUF

Text Generation
GGUF
English
chat
quantized
GGUF
quantization
imat
imatrix
static
16bit
8bit
6bit
5bit
4bit
3bit
2bit
1bit
conversational
Model card Files
xet
 Community
legraphista commited on
Commit
9355973
·
verified ·
1 Parent(s): 1fa58d3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -69,7 +69,7 @@ Link: [here](https://huggingface.co/legraphista/Qwen2-Math-72B-Instruct-IMat-GGU
69
  ### All Quants
70
  | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
71
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
72
- | Qwen2-Math-72B-Instruct.BF16 | BF16 | - | ⏳ Processing | ⚪ Static | -
73
  | Qwen2-Math-72B-Instruct.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
74
  | [Qwen2-Math-72B-Instruct.Q8_0/*](https://huggingface.co/legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF/tree/main/Qwen2-Math-72B-Instruct.Q8_0) | Q8_0 | 77.26GB | ✅ Available | ⚪ Static | ✂ Yes
75
  | [Qwen2-Math-72B-Instruct.Q6_K/*](https://huggingface.co/legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF/tree/main/Qwen2-Math-72B-Instruct.Q6_K) | Q6_K | 64.35GB | ✅ Available | ⚪ Static | ✂ Yes
 
69
  ### All Quants
70
  | Filename | Quant type | File Size | Status | Uses IMatrix | Is Split |
71
  | -------- | ---------- | --------- | ------ | ------------ | -------- |
72
+ | [Qwen2-Math-72B-Instruct.BF16/*](https://huggingface.co/legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF/tree/main/Qwen2-Math-72B-Instruct.BF16) | BF16 | 145.42GB | ✅ Available | ⚪ Static | ✂ Yes
73
  | Qwen2-Math-72B-Instruct.FP16 | F16 | - | ⏳ Processing | ⚪ Static | -
74
  | [Qwen2-Math-72B-Instruct.Q8_0/*](https://huggingface.co/legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF/tree/main/Qwen2-Math-72B-Instruct.Q8_0) | Q8_0 | 77.26GB | ✅ Available | ⚪ Static | ✂ Yes
75
  | [Qwen2-Math-72B-Instruct.Q6_K/*](https://huggingface.co/legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF/tree/main/Qwen2-Math-72B-Instruct.Q6_K) | Q6_K | 64.35GB | ✅ Available | ⚪ Static | ✂ Yes