RunLocalAI
other
120B parameters
Commercial OK

Nemotron 3 Super (120B-A12B)

Workstation-tier Nemotron 3. 120B total / 12B active. 5× higher throughput than the prior Super, 1M context, designed for multi-agent applications.

License: NVIDIA Open Model License·Released Feb 15, 2026·Context: 1,000,000 tokens

Overview

Workstation-tier Nemotron 3. 120B total / 12B active. 5× higher throughput than the prior Super, 1M context, designed for multi-agent applications.

Strengths

  • 5× throughput vs prior gen
  • 1M context
  • Multi-agent design

Weaknesses

  • Server / multi-GPU only

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M72.0 GB84 GB

Get the model

Ollama

One-line install

ollama run nemotron3:superRead our Ollama review →

HuggingFace

Original weights

huggingface.co/nvidia/Nemotron-3-Super

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of Nemotron 3 Super (120B-A12B).

NVIDIA GB200 NVL72
13824GB · nvidia
AMD Instinct MI355X
288GB · amd
AMD Instinct MI325X
256GB · amd
NVIDIA B200
192GB · nvidia
AMD Instinct MI300X
192GB · amd
NVIDIA H100 NVL
188GB · nvidia
NVIDIA H200
141GB · nvidia
AMD Instinct MI250X
128GB · amd
Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Step up
More capable — bigger memory footprint
No verdicted models in the next tier up yet.

Frequently asked

What's the minimum VRAM to run Nemotron 3 Super (120B-A12B)?

84GB of VRAM is enough to run Nemotron 3 Super (120B-A12B) at the Q4_K_M quantization (file size 72.0 GB). Higher-quality quantizations need more.

Can I use Nemotron 3 Super (120B-A12B) commercially?

Yes — Nemotron 3 Super (120B-A12B) ships under the NVIDIA Open Model License, which permits commercial use. Always read the license text before deployment.

What's the context length of Nemotron 3 Super (120B-A12B)?

Nemotron 3 Super (120B-A12B) supports a context window of 1,000,000 tokens (about 1000K).

How do I install Nemotron 3 Super (120B-A12B) with Ollama?

Run `ollama pull nemotron3:super` to download, then `ollama run nemotron3:super` to start a chat session. The default quantization is Q4_K_M.

Source: huggingface.co/nvidia/Nemotron-3-Super

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.