minicpm
4B parameters
Commercial OK
Reviewed November 2026

MiniCPM 3 4B

OpenBMB's edge-optimized 4B. Apache-2.0 license; designed for phone deployment. Strong reasoning per parameter.

License: Apache-2.0·Released Sep 12, 2024·Context: 32,768 tokens

Overview

OpenBMB's edge-optimized 4B. Apache-2.0 license; designed for phone deployment. Strong reasoning per parameter.

Strengths

  • Apache-2.0 license
  • Phone-deployable
  • Strong reasoning per param

Weaknesses

  • 4B ceiling limits open-ended generation depth

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M2.4 GB4 GB

Get the model

HuggingFace

Original weights

huggingface.co/openbmb/MiniCPM3-4B

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of MiniCPM 3 4B.

NVIDIA GeForce GTX 1050 Ti
4GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1650
4GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1650 Super
4GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce RTX 3050 Ti (Mobile)
4GB · nvidia · fits by VRAM, no benchmark yet
AMD Radeon RX 570
4GB · amd · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1060 6GB
6GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1660
6GB · nvidia · fits by VRAM, no benchmark yet
NVIDIA GeForce GTX 1660 Super
6GB · nvidia · fits by VRAM, no benchmark yet
Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Step down
Smaller — faster, runs on weaker hardware

Frequently asked

What's the minimum VRAM to run MiniCPM 3 4B?

4GB of VRAM is enough to run MiniCPM 3 4B at the Q4_K_M quantization (file size 2.4 GB). Higher-quality quantizations need more.

Can I use MiniCPM 3 4B commercially?

Yes — MiniCPM 3 4B ships under the Apache-2.0, which permits commercial use. Always read the license text before deployment.

What's the context length of MiniCPM 3 4B?

MiniCPM 3 4B supports a context window of 32,768 tokens (about 33K).

Source: huggingface.co/openbmb/MiniCPM3-4B

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.

Related — keep moving

Compare hardware
Buyer guides
When it doesn't work
Recommended hardware
Before you buy

Verify MiniCPM 3 4B runs on your specific hardware before committing money.

Will it run on my hardware? →Custom hardware comparison →GPU recommender (4 questions) →