Instructions to use NLPnorth/snakmodel-7b-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use NLPnorth/snakmodel-7b-base with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="NLPnorth/snakmodel-7b-base")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("NLPnorth/snakmodel-7b-base")
model = AutoModelForCausalLM.from_pretrained("NLPnorth/snakmodel-7b-base", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use NLPnorth/snakmodel-7b-base with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "NLPnorth/snakmodel-7b-base"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "NLPnorth/snakmodel-7b-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/NLPnorth/snakmodel-7b-base

SGLang

How to use NLPnorth/snakmodel-7b-base with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "NLPnorth/snakmodel-7b-base" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "NLPnorth/snakmodel-7b-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "NLPnorth/snakmodel-7b-base" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "NLPnorth/snakmodel-7b-base",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use NLPnorth/snakmodel-7b-base with Docker Model Runner:
```
docker model run hf.co/NLPnorth/snakmodel-7b-base
```

snakmodel-7b-base

Commit History

May 15, 2025

12:35
Update README.md

jjzha

Verified signature
e848422

Nov 22, 2024

10:55
Upload tokenizer.json with huggingface_hub

jjzha

Verified signature
ddc106b
10:45
Delete added_tokens.json

jjzha

Verified signature
cea4d9e

Nov 19, 2024

15:23
Upload tokenizer_config.json with huggingface_hub

jjzha

Verified signature
4d895e5
11:07
Upload tokenizer_config.json with huggingface_hub

jjzha

Verified signature
a919659
11:07
Upload special_tokens_map.json with huggingface_hub

jjzha

Verified signature
c078cb5
11:05
Delete .locks

jjzha

Verified signature
75887fa
11:05
Delete models--NLPnorth--snakmodel-7b-base

jjzha

Verified signature
6fa81bc
11:05
Upload .locks/models--NLPnorth--snakmodel-7b-base/4c8988d40c2efb718744eefa7d4d915e17b40df7.lock with huggingface_hub

jjzha

Verified signature
9959046
11:05
Upload .locks/models--NLPnorth--snakmodel-7b-base/a6344aac8c09253b3b630fb776ae94478aa0275b.lock with huggingface_hub

jjzha

Verified signature
9d130ce
11:05
Upload models--NLPnorth--snakmodel-7b-base/refs/main with huggingface_hub

jjzha

Verified signature
0809125
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer_config.json with huggingface_hub

jjzha

Verified signature
15fb22c
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer.model with huggingface_hub

jjzha

Verified signature
2b1effb
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer.json with huggingface_hub

jjzha

Verified signature
0cb737d
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/special_tokens_map.json with huggingface_hub

jjzha

Verified signature
9369917
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/snakmodel-base.png with huggingface_hub

jjzha

Verified signature
118e6f1
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/model.safetensors.index.json with huggingface_hub

jjzha

Verified signature
0df0db0
11:05
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/generation_config.json with huggingface_hub

jjzha

Verified signature
c639d21
11:04
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/config.json with huggingface_hub

jjzha

Verified signature
3330e37
11:04
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/README.md with huggingface_hub

jjzha

Verified signature
480c27a
11:04
Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/.gitattributes with huggingface_hub

jjzha

Verified signature
bbc6f25
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/04a6b76c7b984884db39812a5ab72a8adc931a89 with huggingface_hub

jjzha

Verified signature
d7c21a2
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347 with huggingface_hub

jjzha

Verified signature
4e35e58
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/86fe1a5aa6953e93b0b2020609b0a52c11621259 with huggingface_hub

jjzha

Verified signature
d4f5953
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/1e59223bfb9c3e9c479515876e9e5d164924ecaa with huggingface_hub

jjzha

Verified signature
0ef1a23
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/814e1426a83b0eed37b690ab766e7535403e53bf with huggingface_hub

jjzha

Verified signature
9a91132
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/13674e51e613232b3becd7046ec62b76392c976e with huggingface_hub

jjzha

Verified signature
6c264d2
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/589fbcab306e58ba6d65e7dde03c89eb03ab6595 with huggingface_hub

jjzha

Verified signature
bd0affb
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/1f293b23113f1f3a34183cf34fd0be781156fb20 with huggingface_hub

jjzha

Verified signature
d15f2e3
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/48482c1623390e7ba8be812c489d663cc138d0b1 with huggingface_hub

jjzha

Verified signature
410793f
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/4c8988d40c2efb718744eefa7d4d915e17b40df7 with huggingface_hub

jjzha

Verified signature
838bdc1
11:04
Upload models--NLPnorth--snakmodel-7b-base/blobs/a6344aac8c09253b3b630fb776ae94478aa0275b with huggingface_hub

jjzha

Verified signature
321964c

Oct 21, 2024

08:17
uploaded final SnakModel-7B (base) model

personads

Verified signature
a8035fc
08:16
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
581063d

Oct 18, 2024

16:06
added library to metadata

personads

Verified signature
8fcecee
15:39
uploaded final SnakModel-7B (base) model

personads

Verified signature
7e4ed68
15:38
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
bbc3a52
15:04
uploaded final SnakModel-7B (base) model

personads

Verified signature
aff6e00
15:03
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
3e20795
14:29
uploaded final SnakModel-7B (base) model

personads

Verified signature
1612e57
14:29
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
7f9ccd8
14:09
uploaded final SnakModel-7B (base) model

personads

Verified signature
0ebf7e1
14:08
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
5e0188b
14:00
uploaded final SnakModel-7B (base) model

personads

Verified signature
1198e84
14:00
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
8b7d5a1
13:55
uploaded final SnakModel-7B (base) model

personads

Verified signature
1354e4f
13:52
uploaded final SnakModel-7B (base) tokenizer

personads

Verified signature
267086f

Oct 17, 2024

09:58
added initial model card

Max Müller-Eberstein

f87f301
09:57
initial commit

personads

Verified signature
0207816

Commit History

May 15, 2025

Update README.md

Nov 22, 2024

Upload tokenizer.json with huggingface_hub

Delete added_tokens.json

Nov 19, 2024

Upload tokenizer_config.json with huggingface_hub

Upload tokenizer_config.json with huggingface_hub

Upload special_tokens_map.json with huggingface_hub

Delete .locks

Delete models--NLPnorth--snakmodel-7b-base

Upload .locks/models--NLPnorth--snakmodel-7b-base/4c8988d40c2efb718744eefa7d4d915e17b40df7.lock with huggingface_hub

Upload .locks/models--NLPnorth--snakmodel-7b-base/a6344aac8c09253b3b630fb776ae94478aa0275b.lock with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/refs/main with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer_config.json with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer.model with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/tokenizer.json with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/special_tokens_map.json with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/snakmodel-base.png with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/model.safetensors.index.json with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/generation_config.json with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/config.json with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/README.md with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/snapshots/a8035fc09140828488a858d9b56c8dc3b14288a6/.gitattributes with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/04a6b76c7b984884db39812a5ab72a8adc931a89 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/86fe1a5aa6953e93b0b2020609b0a52c11621259 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/1e59223bfb9c3e9c479515876e9e5d164924ecaa with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/814e1426a83b0eed37b690ab766e7535403e53bf with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/13674e51e613232b3becd7046ec62b76392c976e with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/589fbcab306e58ba6d65e7dde03c89eb03ab6595 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/1f293b23113f1f3a34183cf34fd0be781156fb20 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/48482c1623390e7ba8be812c489d663cc138d0b1 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/4c8988d40c2efb718744eefa7d4d915e17b40df7 with huggingface_hub

Upload models--NLPnorth--snakmodel-7b-base/blobs/a6344aac8c09253b3b630fb776ae94478aa0275b with huggingface_hub

Oct 21, 2024

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

Oct 18, 2024

added library to metadata

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

uploaded final SnakModel-7B (base) model

uploaded final SnakModel-7B (base) tokenizer

Oct 17, 2024

added initial model card

initial commit