Image-Text-to-Text
Transformers
Safetensors
English
Chinese
sensenova_loop
text-generation
multimodal
looped-transformer
mhc
custom_code
conversational
Instructions to use sensenova/SenseNova-Loop-9B-Preview with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sensenova/SenseNova-Loop-9B-Preview with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="sensenova/SenseNova-Loop-9B-Preview", trust_remote_code=True) messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("sensenova/SenseNova-Loop-9B-Preview", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use sensenova/SenseNova-Loop-9B-Preview with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "sensenova/SenseNova-Loop-9B-Preview" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sensenova/SenseNova-Loop-9B-Preview", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/sensenova/SenseNova-Loop-9B-Preview
- SGLang
How to use sensenova/SenseNova-Loop-9B-Preview with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "sensenova/SenseNova-Loop-9B-Preview" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sensenova/SenseNova-Loop-9B-Preview", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "sensenova/SenseNova-Loop-9B-Preview" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "sensenova/SenseNova-Loop-9B-Preview", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use sensenova/SenseNova-Loop-9B-Preview with Docker Model Runner:
docker model run hf.co/sensenova/SenseNova-Loop-9B-Preview
Commit History
16 days ago
-
docs: consolidate speculative decoding training instructions
Verified signature9937e91 -
docs: add ModelScope model badges
Verified signature90dab7a
17 days ago
-
docs: add vLLM deployment and clarify SGLang PR version
Verified signatureeda5d06
19 days ago
-
docs: update GitHub badge to SenseNova-Loop
Verified signatureUse the renamed GitHub repository URL and SenseNova-Loop badge label in both model cards.27abea7 -
docs: align training commands with current repository examples
Verified signatureUse the local model path, updated training guide and DSpark path, and add the DFlash2 command. Preserve existing prose.c602ae2 -
docs: add GitHub badge to model cards
Verified signatureLink the English and Chinese model cards to the official GitHub repository.339d6ca -
docs: standardize model name as SenseNova-Loop-9B-Preview
Verified signatureUpdate English and Chinese model cards, links, model IDs, deployment examples, training paths and citations. Retain existing benchmark image.e5ca0b2 -
docs: clarify shared decoder weights and simplify loading notes
Verified signaturea219b37 -
Update model training script path
Verified signature82b8a48 -
Add SGLang PR checkout and source installation commands
Verified signature70e44de -
Add model fine-tuning and DSpark training examples
Verified signature117261a -
Make training and deployment top-level sections
Verified signatured97272a -
Sync latest bilingual GitHub READMEs and fix deployment heading hierarchy
Verified signatureba04ec4 -
Add SGLang deployment example
Verified signatureb6750d5
20 days ago
-
Add Transformers dependencies and Hugging Face model ID
Verified signature3462613 -
Add LightLLM deployment and request examples
Verified signature3932518 -
Document existing Apache 2.0 license in model cards
Verified signature784ba44 -
Replace architecture figure with an introductory overview
Verified signature4bd4eed -
Remove training sequence length caveat
Verified signature5178690 -
Recommend documented deployment setup for best model performance
Verified signaturea3f9d4b -
Restore complete bilingual model cards and add Odyssey showcase
Verified signature305dcb2 -
Add English and Chinese model cards with showcase assets
Verified signature9f81cc8