bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Oct 16, 2024 • 4.79k • 105
lmstudio-community/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Oct 15, 2024 • 558 • 38
mlx-community/nvidia_Llama-3.1-Nemotron-70B-Instruct-HF_4bit Text Generation • Updated Oct 16, 2024 • 850 • 12
mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-8bit Text Generation • 20B • Updated Oct 17, 2024 • 147 • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic Text Generation • 71B • Updated Oct 23, 2025 • 906 • 15
unsloth/Llama-3.1-Nemotron-70B-Instruct-bnb-4bit Text Generation • 73B • Updated Oct 17, 2024 • 164 • 20
DevQuasar-5/nvidia.Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Feb 1, 2025 • 57 • 1
mlx-community/Llama-3.1-Nemotron-70B-Instruct-HF-4bit Text Generation • 11B • Updated Oct 17, 2024 • 174 • 2
second-state/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF Text Generation • 71B • Updated Oct 18, 2024 • 108
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-65536-woft 8B • Updated Feb 25, 2025 • 2
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v8-k65536-65536-woft 11B • Updated Feb 25, 2025 • 3 • 5
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-16384-woft 7B • Updated Feb 25, 2025 • 3
VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-256-woft 6B • Updated Feb 25, 2025 • 14 • 1
ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4 Text Generation • 71B • Updated Dec 7, 2024 • 301 • 6
joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4 Text Generation • 71B • Updated Nov 5, 2024 • 7 • 3