Instructions to use summerAIO/Longbook-Looped-8-4-pre with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use summerAIO/Longbook-Looped-8-4-pre with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="summerAIO/Longbook-Looped-8-4-pre", trust_remote_code=True)
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("summerAIO/Longbook-Looped-8-4-pre", trust_remote_code=True)
model = AutoModelForImageTextToText.from_pretrained("summerAIO/Longbook-Looped-8-4-pre", trust_remote_code=True, device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use summerAIO/Longbook-Looped-8-4-pre with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "summerAIO/Longbook-Looped-8-4-pre"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "summerAIO/Longbook-Looped-8-4-pre",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/summerAIO/Longbook-Looped-8-4-pre

SGLang

How to use summerAIO/Longbook-Looped-8-4-pre with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "summerAIO/Longbook-Looped-8-4-pre" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "summerAIO/Longbook-Looped-8-4-pre",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "summerAIO/Longbook-Looped-8-4-pre" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "summerAIO/Longbook-Looped-8-4-pre",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use summerAIO/Longbook-Looped-8-4-pre with Docker Model Runner:
```
docker model run hf.co/summerAIO/Longbook-Looped-8-4-pre
```

summer commited on 16 days ago

Commit

786e2c3

verified ·

1 Parent(s): a576bdc

Add files using upload-large-folder tool

Browse files

This view is limited to 50 files because it contains too many changes. See raw diff

Files changed (50) hide show

quantized/0000.safetensors +3 -0
quantized/0015.safetensors +3 -0
quantized/0025.safetensors +3 -0
quantized/0036.safetensors +3 -0
quantized/0044.safetensors +3 -0
quantized/0047.safetensors +3 -0
quantized/0052.safetensors +3 -0
quantized/0055.safetensors +3 -0
quantized/0059.safetensors +3 -0
quantized/0060.safetensors +3 -0
quantized/0062.safetensors +3 -0
quantized/0071.safetensors +3 -0
quantized/0075.safetensors +3 -0
quantized/0076.safetensors +3 -0
quantized/0095.safetensors +3 -0
quantized/0097.safetensors +3 -0
quantized/0108.safetensors +3 -0
quantized/0110.safetensors +3 -0
quantized/0115.safetensors +3 -0
quantized/0116.safetensors +3 -0
quantized/0118.safetensors +3 -0
quantized/0120.safetensors +3 -0
quantized/0121.safetensors +3 -0
quantized/0129.safetensors +3 -0
quantized/0133.safetensors +3 -0
quantized/0136.safetensors +3 -0
quantized/0140.safetensors +3 -0
quantized/0147.safetensors +3 -0
quantized/0148.safetensors +3 -0
quantized/0149.safetensors +3 -0
quantized/0173.safetensors +3 -0
quantized/0177.safetensors +3 -0
quantized/0181.safetensors +3 -0
quantized/0193.safetensors +3 -0
quantized/0199.safetensors +3 -0
quantized/0213.safetensors +3 -0
quantized/0215.safetensors +3 -0
quantized/0219.safetensors +3 -0
quantized/0228.safetensors +3 -0
quantized/0235.safetensors +3 -0
quantized/0241.safetensors +3 -0
quantized/0254.safetensors +3 -0
quantized/0266.safetensors +3 -0
quantized/0268.safetensors +3 -0
quantized/0271.safetensors +3 -0
quantized/0274.safetensors +3 -0
quantized/0289.safetensors +3 -0
quantized/0292.safetensors +3 -0
quantized/0300.safetensors +3 -0
quantized/0303.safetensors +3 -0

quantized/0000.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:35081b7b27e2ac5d3a0f2e10fab5ef262ab844b002fc9ac88544fa4ed7a06751
+size 4238557

quantized/0015.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf7767018b6b0f55084684ae53bce2e9abed5721585153b73a0b5229f83ae257
+size 6201565

quantized/0025.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4e319e0d4df2ca3eb805af1e82d58269b49c34b651edf18e79ab95032f84b157
+size 1413845

quantized/0036.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:50dbf9263b0355cf259fc6b99cfb1a95aa4fc7858f7206fe71ba209d8ba69da6
+size 4238557

quantized/0044.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bb0ca0a26ec2c62940d5d5c7be859c38f819f0c90f5713bed8738f3c89ec6904
+size 4238557

quantized/0047.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f2c9a547aac04fad11ab638a6efba2fc08bfa96c4e14608a0569b183a8eea900
+size 6201565

quantized/0052.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0426de04ae042085839f8709d663dd19841efaba1402e553aca2d23a69512d02
+size 4238557

quantized/0055.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e16a1302f94c8a64061a4d20512c91a852e115b68b05368c5f8f0354a2d20e78
+size 6201565

quantized/0059.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:406442eb412ff6f4ce318e803636d262e946b517e7d7a30b8d81ceee896cbea4
+size 6201565

quantized/0060.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d82b474b8f6e47a1e5ce7344d07f4a80ffd1c17383b690221f93dd9785b4727b
+size 4238557

quantized/0062.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c35a7404e1350346deb9355a9a3030ffc8700d30b13fe3d5a422df24808aca89
+size 5278205

quantized/0071.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:bdd3a9e1099c0e9e51b7bc8214d23d0647a22171cd30b2cc4e8929a9f2773ea9
+size 6201565

quantized/0075.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fc9f035b86e0f9b921fc0d3b39d09d65657090541b3ed27615dbe3b408424740
+size 6201565

quantized/0076.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5adb73f145ee5414170e7538970b25bfbaa2671261c51401078aaa1465e13cc
+size 4238557

quantized/0095.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1a561db2ba94f7e18489ccb359fb50d035de3f5306e778b951ad9aba51cc262d
+size 6201565

quantized/0097.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d5509d805913810500b7c9c20cc4027cd36ced50e32728a3e2b3f0d64ab77a95
+size 1413845

quantized/0108.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:16afb46b533b52c9822e5735b277df30520e1d04c66801378caa062e764dfb76
+size 22571509

quantized/0110.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cebce7eeccce221f1159d56ac6b90af82e7c7b8e33bab18cf37d9f0a6b26159d
+size 33424821

quantized/0115.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed2260c8695d3660aee1067b90cfe0d868869e7b35ba8f944d367b1cd4710b35
+size 94700989

quantized/0116.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4830db96feee543fe912309ffa80c15401f4468a44676ed9ae5d10e8ff69a14d
+size 94700989

quantized/0118.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b0f46e30894cc5adf0f0b955f482bc175bc71f45dccc08051022f6b4a01e29e5
+size 33424821

quantized/0120.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:90f674a1484762766a17b48f6be1e11574a423bdd9a54db41c86128ab5f9c203
+size 33424821

quantized/0121.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:849ac00cc4d4964fded73946ba890d108551a3236313b0252c6e875072434b32
+size 262517

quantized/0129.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b0a51803d4840ccf941c2f0eb52021b2f6c4f31bcf0b1cbe3eccda143d9ff1a4
+size 262517

quantized/0133.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8c8cd2a4a1ab3aa8412baa2bc589d318cd30d8d3f69e7a4a647008466b1b210d
+size 94700989

quantized/0136.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d8eb539659dd669d23e6ee3a3a28696694ce6ac103024e60ed0bcb0a08143040
+size 33424821

quantized/0140.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:61accbdaa2d23af85ec68c58ca4d1ead57d8ccff760d3af017128db851425fba
+size 94700989

quantized/0147.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:991df61d14fa8770686780fedef2923fa9b03da032d3a755ade1f51b627a1693
+size 50136509

quantized/0148.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:10b41b0cbddc4d49f77ebd7979591c8e9aa301cc4a140b6135b5a710398df50e
+size 94700989

quantized/0149.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5b491a0689e80bf27a5d17efc9951278b2b24ce2113289d50302136f46fb326c
+size 94700989

quantized/0173.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dedc84a7047573a234b726d37e8bdac906906a28907f1ac03e99972db531bd0d
+size 94700989

quantized/0177.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:981603d02f1356a49087c38d48912e2e7cc71d6de998eede52ea1e1a72b9ef47
+size 262517

quantized/0181.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:764891ba01cdb102cabd1451d4bf25c4ebf6bda6936237785a32c26bd714bbd3
+size 94700989

quantized/0193.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9989e2a6c8ce258f9408aabca1c704ba5a8350d31ab69edaf28b240a19d33e40
+size 262517

quantized/0199.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:2b1955d3d1ac11c5b17bb580c1467fad76ec462db4ce4061a97429a29c0b3372
+size 55707061

quantized/0213.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0a2f7572cf0190d98ef576361af37e68353e4f9ab7dba0a155875350a51ff4e0
+size 94700989

quantized/0215.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3c528b481b8de577cd3d0d414ed70e61a6c98f13f364d4bc4ea65a67a786494f
+size 55707061

quantized/0219.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f3d3d74f6b30928d859478f3770c229defa761a70b4d89cd5ce99c51313db052
+size 50136509

quantized/0228.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1434b7a1bf9ef261d934e50bc8e2aa74c5a7258b66f408b8380fa5a9f887258d
+size 94700989

quantized/0235.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:820cbec4c735271ee58dc4de2eaa5346954da17201fff3f9d7b80d3d8e366bb5
+size 50136509

quantized/0241.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5771f12efcdf9162de3ca48016b67798bb520ec1a148e798eafad8faa371a180
+size 262517

quantized/0254.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:55c763e941abc80d146bea0ecbd49725bce038876362872f8ee50f781d1b8ccb
+size 33424821

quantized/0266.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0df3162bd6ebaefa6558a53b85aba072316d315902ee9376f4f7d7b6a9b3b2bc
+size 262517

quantized/0268.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6a05c5a2a1918451c9316e4beffda44bcd568d21294039a274cb97e431702bce
+size 50136509

quantized/0271.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b3248d29fdbbce45d5480f6eaf122f9a98b9cefe48cb9f1aa8cd191202aaad14
+size 55707061

quantized/0274.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:637effdb69f88bb61cb152e8f35be96d241aa57f4b699f9fc4a29d3865312a71
+size 262517

quantized/0289.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:010ee261ab3f0d10a5fd84b1a5c3979be5bb0bfdaf3bd80fbac09c76eef6f593
+size 262517

quantized/0292.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:77861512ff3dcacc03583bacd37fc06d89d87ac510791be29a65bcf15a59b8fc
+size 50136509

quantized/0300.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:515d0024558a1465ed971ef33ca73dad367696fcbdaaf74a06ade885069aa570
+size 50136509

quantized/0303.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9cf9fd3e69b6835872b735dfc479731c6ec1835cf384412e096ac2b4b64c27f3
+size 55707061