Instructions to use WasamiKirua/NightShade-Lotus-12B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("WasamiKirua/NightShade-Lotus-12B-GGUF", dtype="auto") - llama-cpp-python
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="WasamiKirua/NightShade-Lotus-12B-GGUF", filename="NightShade-Lotus-12B-F16.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16 # Run inference directly in the terminal: llama-cli -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16 # Run inference directly in the terminal: llama-cli -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16 # Run inference directly in the terminal: ./llama-cli -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf WasamiKirua/NightShade-Lotus-12B-GGUF:F16
Use Docker
docker model run hf.co/WasamiKirua/NightShade-Lotus-12B-GGUF:F16
- LM Studio
- Jan
- Ollama
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with Ollama:
ollama run hf.co/WasamiKirua/NightShade-Lotus-12B-GGUF:F16
- Unsloth Studio
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for WasamiKirua/NightShade-Lotus-12B-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for WasamiKirua/NightShade-Lotus-12B-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for WasamiKirua/NightShade-Lotus-12B-GGUF to start chatting
- Docker Model Runner
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with Docker Model Runner:
docker model run hf.co/WasamiKirua/NightShade-Lotus-12B-GGUF:F16
- Lemonade
How to use WasamiKirua/NightShade-Lotus-12B-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull WasamiKirua/NightShade-Lotus-12B-GGUF:F16
Run and chat with the model
lemonade run user.NightShade-Lotus-12B-GGUF-F16
List all available models
lemonade list
π Nightshade-Lotus-12B (Unbound Edition)
Nightshade-Lotus-12B is a high-intensity, uncensored storytelling and general roleplay model based on the Mistral-Nemo (12B) architecture. It is designed to bridge the gap between descriptive, novel-style prose and raw, visceral emotional intensity.
Unlike the specialized "Sakura" models, Nightshade-Lotus is a Savage Bard: it excels at world-building, sensory details, and uninhibited character interactions, favoring dramatic stakes and "Unbound" narratives over strict logical safety.
π§ The "Unbound" Merge Recipe
This model utilizes a DARE-TIES merge to balance four distinct personalities into a cohesive storytelling engine, maintaining a high density to preserve a rich, descriptive vocabulary.
Configuration
The following YAML configuration was used to produce this model:
models:
- model: FallenMerick/MN-Chunky-Lotus-12B
parameters:
weight: 0.45 # The Body: Narrative engine, prose depth, and max uncensored capability.
- model: Vortex5/Crimson-Constellation-12B
parameters:
weight: 0.25 # The Heart: High-intensity emotional reactions and dramatic volatility.
- model: Vortex5/Moonlit-Mirage-12B
parameters:
weight: 0.15 # The Vibe: Atmospheric depth and dark, cynical undertones.
- model: Vortex5/Cosmic-Night-12B
parameters:
weight: 0.15 # The Anchor: Basic instruction adherence and structural stability.
merge_method: dare_ties
base_model: Vortex5/NoctyxCosma-12B
parameters:
density: 0.60 # High density for rich vocabulary and storytelling detail.
weight: 1.0
dtype: bfloat16
tokenizer_source: base
πͺ Key Strengths
Savage Prose: Capable of generating rich, immersive descriptions. It doesn't just tell you what happens; it makes you feel the "dirt and the blood" of the scene.
Unfiltered Intensity: Completely uncensored. It will navigate dark themes, explicit content, and extreme psychological drama without hesitation.
Emotional Volatility: Characters feel alive and reactive. Their responses are driven by the "intensity" weight, making interactions feel high-stakes and unpredictable.
Bilingual Mastery: Built on NoctyxCosma, it handles both Italian and English with native-level fluency, maintaining the same "dark" tone in both languages.
π Best Use Cases
Dark Fantasy & Cyber-Noir RP: Where the environment is as much a character as the NPCs.
Intense Character Studies: Exploring complex, raw, and often non-compliant character dynamics.
Long-Form Storytelling: Creating chapters or scenes that require sensory detail and "showing, not telling."
β οΈ Limitations
Intensity over Logic: The model may occasionally prioritize a dramatic moment over strict internal consistency. It is best used with an external memory framework or "World Info" management.
Non-Brevity: This model likes to talk. It is not recommended for users seeking 10-token "SMS-style" chat responses.
Purely Unbound: It has zero safety guardrails. Use responsibly within private, creative contexts.
π Recommended Inference Settings
To keep the "Bard" from rambling too much while preserving the intensity:
Temperature: 0.8 - 0.9 (for maximum creative flair).
Min-P: 0.05 - 0.1
Repetition Penalty: 1.1
Max Tokens: Recommended setting around 512-800 to allow for descriptive prose without hitting the 1024 cap unnecessarily.
Disclaimer
Nightshade-Lotus-12B is an experimental storytelling model. It is designed to be visceral, dark, and unfiltered. It does not reflect any safety guidelines and is intended for mature creative exploration only.
- Downloads last month
- 98
8-bit
16-bit
Model tree for WasamiKirua/NightShade-Lotus-12B-GGUF
Base model
Vortex5/NoctyxCosma-12B