Hugging Face's logo

RyeAI
/
STD-BPE-LLAMA3.2

Text Generation
Transformers
Safetensors
llama
Danish
BPE Tokenization
LLaMA
text-generation-inference
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="RyeAI/STD-BPE-LLAMA3.2")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("RyeAI/STD-BPE-LLAMA3.2")
model = AutoModelForCausalLM.from_pretrained("RyeAI/STD-BPE-LLAMA3.2", device_map="auto")
Quick Links

STD-BPE-LLAMA3.2

A standard LLaMA-3.2 model trained with a pretrained Byte-Pair-Encoding (BPE) tokenizer. It provides a benchmark for evaluating the performance of more advanced tokenization approaches.

Downloads last month
9
Safetensors
Model size
1B params
Tensor type
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including RyeAI/STD-BPE-LLAMA3.2