other
4B parameters
Commercial OK
Reviewed October 2026

Nemotron Mini 4B Instruct

NVIDIA's edge-tier Nemotron. Distilled from Minitron lineage with role-play tuning.

License: NVIDIA Open Model License·Released Sep 13, 2024·Context: 4,096 tokens

Overview

NVIDIA's edge-tier Nemotron. Distilled from Minitron lineage with role-play tuning.

Strengths

  • Edge-deployable
  • NVIDIA-tuned

Weaknesses

  • NVIDIA Open Model License — read carefully

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M2.5 GB4 GB

Get the model

HuggingFace

Original weights

huggingface.co/nvidia/Nemotron-Mini-4B-Instruct

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of Nemotron Mini 4B Instruct.

NVIDIA GeForce GTX 1050 Ti
4GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1650
4GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1650 Super
4GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce RTX 3050 Ti (Mobile)
4GB · nvidia · fits by VRAM, no benchmark yet
AMD Radeon RX 570
4GB · amd · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1060 6GB
6GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1660
6GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1660 Super
6GB · nvidia · fits by VRAM, no benchmark yet
Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Step down
Smaller — faster, runs on weaker hardware

Frequently asked

What's the minimum VRAM to run Nemotron Mini 4B Instruct?

4GB of VRAM is enough to run Nemotron Mini 4B Instruct at the Q4_K_M quantization (file size 2.5 GB). Higher-quality quantizations need more.

Can I use Nemotron Mini 4B Instruct commercially?

Yes — Nemotron Mini 4B Instruct ships under the NVIDIA Open Model License, which permits commercial use. Always read the license text before deployment.

What's the context length of Nemotron Mini 4B Instruct?

Nemotron Mini 4B Instruct supports a context window of 4,096 tokens (about 4K).

Source: huggingface.co/nvidia/Nemotron-Mini-4B-Instruct

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.

Related — keep moving

Compare hardware
Buyer guides
When it doesn't work
Recommended hardware
Before you buy

Verify Nemotron Mini 4B Instruct runs on your specific hardware before committing money.

Will it run on my hardware? →Custom hardware comparison →GPU recommender (4 questions) →