Instructions to use summerAIO/Longbook-Looped-8-4-pre with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use summerAIO/Longbook-Looped-8-4-pre with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="summerAIO/Longbook-Looped-8-4-pre", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("summerAIO/Longbook-Looped-8-4-pre", trust_remote_code=True)
model = AutoModelForImageTextToText.from_pretrained("summerAIO/Longbook-Looped-8-4-pre", trust_remote_code=True, device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use summerAIO/Longbook-Looped-8-4-pre with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "summerAIO/Longbook-Looped-8-4-pre"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "summerAIO/Longbook-Looped-8-4-pre",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/summerAIO/Longbook-Looped-8-4-pre

SGLang

How to use summerAIO/Longbook-Looped-8-4-pre with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "summerAIO/Longbook-Looped-8-4-pre" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "summerAIO/Longbook-Looped-8-4-pre",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "summerAIO/Longbook-Looped-8-4-pre" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "summerAIO/Longbook-Looped-8-4-pre",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use summerAIO/Longbook-Looped-8-4-pre with Docker Model Runner:
```
docker model run hf.co/summerAIO/Longbook-Looped-8-4-pre
```

summer commited on 18 days ago

Commit

a576bdc

verified ·

1 Parent(s): ea4881a

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

quantized/0001.safetensors +3 -0
quantized/0002.safetensors +3 -0
quantized/0003.safetensors +3 -0
quantized/0006.safetensors +3 -0
quantized/0009.safetensors +3 -0
quantized/0020.safetensors +3 -0
quantized/0021.safetensors +3 -0
quantized/0022.safetensors +3 -0
quantized/0026.safetensors +3 -0
quantized/0029.safetensors +3 -0
quantized/0030.safetensors +3 -0
quantized/0031.safetensors +3 -0
quantized/0033.safetensors +3 -0
quantized/0034.safetensors +3 -0
quantized/0039.safetensors +3 -0
quantized/0045.safetensors +3 -0
quantized/0049.safetensors +3 -0
quantized/0050.safetensors +3 -0
quantized/0051.safetensors +3 -0
quantized/0053.safetensors +3 -0
quantized/0058.safetensors +3 -0
quantized/0061.safetensors +3 -0
quantized/0063.safetensors +3 -0
quantized/0064.safetensors +3 -0
quantized/0079.safetensors +3 -0
quantized/0081.safetensors +3 -0
quantized/0088.safetensors +3 -0
quantized/0089.safetensors +3 -0
quantized/0093.safetensors +3 -0
quantized/0100.safetensors +3 -0
quantized/0102.safetensors +3 -0
quantized/0107.safetensors +3 -0
quantized/0109.safetensors +3 -0
quantized/0111.safetensors +3 -0
quantized/0112.safetensors +3 -0
quantized/0114.safetensors +3 -0
quantized/0119.safetensors +3 -0
quantized/0124.safetensors +3 -0
quantized/0125.safetensors +3 -0
quantized/0126.safetensors +3 -0
quantized/0127.safetensors +3 -0
quantized/0131.safetensors +3 -0
quantized/0135.safetensors +3 -0
quantized/0142.safetensors +3 -0
quantized/0144.safetensors +3 -0
quantized/0145.safetensors +3 -0
quantized/0153.safetensors +3 -0
quantized/0157.safetensors +3 -0
quantized/0162.safetensors +3 -0
quantized/0164.safetensors +3 -0

quantized/0001.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:59fb5f6da43c34b5c800eda7cc329965ac072ee44a164a4b953c9063e7f15ac2
+size 1413845

quantized/0002.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed938c259fcbc35afc646c4d9e62a7d9994b24696aba80f283e5926d53dd92ae
+size 5278205

quantized/0003.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c10d4d66edfb0df033861ce087eb22386d8696435a41e3b4ac6070eb8851cbf8
+size 6201565

quantized/0006.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:356087351969eaa598fa522a4acd3bbd36034f3e4e3dc19b5b297a9e0ad8fc22
+size 5278205

quantized/0009.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ec4f692540ac8f16bff10415e7e966ada1d678370fbc94462fa87e5a4612dd03
+size 1413845

quantized/0020.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2521bedd153176bb4f8675dd2d66702ddb74f0a67361c8d8bb51d705b93a7bf7
+size 4238557

quantized/0021.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:67c85c040bb9214e91bab9846ee3f6e1e6fc11df49bc1aea21e6525c644c452e
+size 1413845

quantized/0022.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bd0e11723bf57386f98367aa0b7fd62f9deae2d6e04fcde292dd23643ea1ee85
+size 5278205

quantized/0026.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3b8e990f2c085e1746430d362685630fddd3da8b5dc0cdd025d671d9e18b2723
+size 5278205

quantized/0029.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3407576448019e5269f3b7f24d8aac8a589ab2008b25d2768873392b3c0b4036
+size 1413845

quantized/0030.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:309653a99a55d03d0fa995ecbee99f788da8ee9967f5c01358416ec6862b70a8
+size 5278205

quantized/0031.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:70015089dd1e2a59f41fbf9e73dffad1d8a88a16d878420b7701c267fdbacc67
+size 6201565

quantized/0033.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ebd5040bb5df5adf78b6ede66e6d207c1018086b7bcb3ac22108876d1eb8c982
+size 1413845

quantized/0034.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f8ad07767fa6f0c2a664c513c70f74a12860c09afcbce22f8203bbc0818e97b8
+size 5278205

quantized/0039.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a1a825651f742df9b8749943084ff237cde698b74e73304b2010639710d77f13
+size 6201565

quantized/0045.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:521ad80c3335c7ea31cd8827efcd7859a9480a2ca5ccec932d52518b49bd1280
+size 1413845

quantized/0049.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d36cb393397be3a93b9ec0b11614fd40aab252986ea1ea1e15498c398298f2b7
+size 1413845

quantized/0050.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a4f6642dc912f147ccd704d64250938a02cbb3783b11e76d9cdb0d82c1b7a09b
+size 5278205

quantized/0051.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c133c52963b608987e0eacbb389b60d03db87796f3821dbe38cccfdb7e089582
+size 6201565

quantized/0053.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5a5663c22f9ef37464a34d302add792c3432e3ae11a2125a305e15257ccd827
+size 1413845

quantized/0058.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5293b65ea3b9b6851945b26d3a86016013a746f08a6e132f2189eee0dc1053c
+size 5278205

quantized/0061.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6c7b7e97fd5281a817775dc99e00a397c8ebb565de7d24ccb244bc871b38e2b0
+size 1413845

quantized/0063.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:704d0b627b75406446d4a27e396d56079a323eaa004cb845661d30d5cd328d41
+size 6201565

quantized/0064.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b97095d20761d977adc208bce9b6b6bdab09ec33bdc8329a7cdcbf847275bf8e
+size 4238557

quantized/0079.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a57764404e0a42a3f1fbfea9bf433d65142ee64fb5716fee0094e48210a8000c
+size 6201565

quantized/0081.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:de3feb701cd8d159717da68a0ef9ac2521ab4f72541f6412df8e9c69c7eb90b7
+size 1413845

quantized/0088.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:728322383596f2e7868699bd28e49a243105fa049f866199be62db657da6e954
+size 4238557

quantized/0089.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:41ed4bb28dcbee8feed2612097896e1ce85501f6e0c15cef66baa71aba009ffe
+size 1413845

quantized/0093.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:50478725ad0c5d4c54c310fa22c688910cbba5efdc5c71f22a3a3d3651f54671
+size 1413845

quantized/0100.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b43ad9b5b57dcfeab17b4aa97c34d9abcb06ba489807530231b66852c3044073
+size 4238557

quantized/0102.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c1c1bd0e12ab1c7c2f48615449f46485ffe13bf6098253cd95e1e1e7b72c4ad5
+size 5278205

quantized/0107.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa4a4909d5e6d216c0c55fce88dfe40a3e97b77c07ac53b3cd8e4e0be0f195e8
+size 6201565

quantized/0109.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5073900f1f7e1e29021d17467f8603aad6ea1696cf94207b978ad81221a83b21
+size 25079293

quantized/0111.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8b023ea6e76c6d91fbcd66c1b24d6013110c7a6f36b8a50ceddc735b345beb91
+size 55707061

quantized/0112.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:84b2aac2bdbb04f778e336f424535cd9d59b987bd83d8470079921b4ba7e480a
+size 33424821

quantized/0114.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:610fb0e07003491568bed7ad862bf9a10423ca7e7fa1bd017502ccf3f85249ea
+size 262517

quantized/0119.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d4634f5f2cab7fc00e266d0d399cd287ba630ebeff675f4453bc18e8ced517e2
+size 55707061

quantized/0124.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5cb06d66da6aaa1dcedc1a8573d8b96beb9f803c433924991e428796e1a9fbc
+size 94700989

quantized/0125.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fab74f42fd54c45467e5fc0ecf5218b7e4de3c1ff3ca1153f1c4397d14066326
+size 94700989

quantized/0126.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:336447ca2c92cd22dd1096cf193d845017ae55105850bf235d02525499f66597
+size 33424821

quantized/0127.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7e548e686e610b468b5a72ef82af1c44ef6d68d55fa4b0d6b9005630083c32a1
+size 55707061

quantized/0131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cdff6dd47a259f83fc4820ab86ea533193ab9d11f58ae661d489e42febc355fe
+size 50136509

quantized/0135.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9eab7bd18939b7b266e5895988d445292bed338065b83ef12f43a4660f8a6eda
+size 55707061

quantized/0142.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ceed377a1f39627c2dc4c1a8a8a6f7fa45e757f7005345ebb6a70d2dcb6daec3
+size 33424821

quantized/0144.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1beb5732920fafde092748084f696a1148b4a265d0fd1593a71d462556a5a5af
+size 33424821

quantized/0145.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:141b9e50c1d979536028e70fd528468759395090723085df90fa3915995071b7
+size 262517

quantized/0153.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:53d29ab45f16d32101ec72deaa7118d8217b1a8109e2ef49def0a9c0c578aa15
+size 262517

quantized/0157.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d016da8cdbb4cca6b1418fa9f404dc7a49be42534ee74d0c9b6c328f3c3a8b54
+size 94700989

quantized/0162.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a46e26126288155fdfb25e49a68116a71fd3c9e6f348638e22e3d883bc8d8388
+size 262517

quantized/0164.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3c2f2ee0402e1428b2e0bcbcd6522351caa1976ecc1199955cb8ae361c55a1b4
+size 94700989