Qingyu Song
SimmonsSongHW
·
AI & ML interests
Learning to Optimize, LLM Compression & Acceleration
Organizations
None yet
Llama3-Quants
QuantTest
-
SimmonsSongHW/Qwen2.5-14B-Instruct-Q8_0-GGUF
Text Generation • 15B • Updated • 1 -
SimmonsSongHW/Qwen2.5-14B-Instruct-Q6_K-GGUF
Text Generation • 15B • Updated • 10 -
SimmonsSongHW/Qwen2.5-14B-Instruct-Q4_K_M-GGUF
Text Generation • 15B • Updated • 49 -
SimmonsSongHW/Meta-Llama-3-8B-Instruct-Q6_K-GGUF
Text Generation • 8B • Updated
Llama3-Quants-Imatrix
Qwen2.5-Quants-Imatrix
Llama3-Quants
Qwen2.5-Quants
QuantTest
-
SimmonsSongHW/Qwen2.5-14B-Instruct-Q8_0-GGUF
Text Generation • 15B • Updated • 1 -
SimmonsSongHW/Qwen2.5-14B-Instruct-Q6_K-GGUF
Text Generation • 15B • Updated • 10 -
SimmonsSongHW/Qwen2.5-14B-Instruct-Q4_K_M-GGUF
Text Generation • 15B • Updated • 49 -
SimmonsSongHW/Meta-Llama-3-8B-Instruct-Q6_K-GGUF
Text Generation • 8B • Updated