Nemotron-3-Super-120B GGUF

Recommended way to run this model:

llama-server -hf ggml-org/Nemotron-3-Super-120B-GGUF

Then, access http://localhost:8080

Downloads last month
789
GGUF
Model size
121B params
Architecture
nemotron_h_moe
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Nemotron-3-Super-120B-GGUF

Quantized
(42)
this model

Collection including ggml-org/Nemotron-3-Super-120B-GGUF