Hugging Face's logo

g0t4
/
ByteDance-Seed-Coder-8B-Instruct-GGUF

GGUF
conversational
Model card Files
xet
 Community

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

g0t4/ByteDance-Seed-Coder-8B-Instruct-GGUF

Based on https://huggingface.co/ByteDance-Seed/Seed-Coder-8B-Instruct

GGUF Conversion 

python convert_hf_to_gguf.py --remote ByteDance-Seed/Seed-Coder-8B-Instruct \
    --outtype f16 --outfile ByteDance-Seed-Coder-8B-Instruct-f16.gguf

./build/bin/llama-quantize ByteDance-Seed-Coder-8B-Instruct-f16.gguf ByteDance-Seed-Coder-8B-Instruct-Q8_0.gguf Q8_0
./build/bin/llama-quantize ByteDance-Seed-Coder-8B-Instruct-f16.gguf ByteDance-Seed-Coder-8B-Instruct-Q4_K_M.gguf Q4_K_M

hf upload ByteDance-Seed-Coder-8B-Instruct-GGUF .
Downloads last month
22
GGUF
Model size
8B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support