Qwen 3 4B
Compact Qwen 3 for edge and laptop deployment. Outperforms many 7B models from prior generations.
Overview
Compact Qwen 3 for edge and laptop deployment. Outperforms many 7B models from prior generations.
Family & lineage
How this model relates to others in its lineage. Family members share architecture and training-data roots; parent / children edges record direct distillation or fine-tune relationships.
Strengths
- Edge-class footprint
- Apache 2.0
Weaknesses
- Reasoning weaker than 8B+
Quantization variants
Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.
| Quantization | File size | VRAM required |
|---|---|---|
| Q4_K_M | 2.5 GB | 4 GB |
| Q8_0 | 4.4 GB | 6 GB |
Get the model
Ollama
One-line install
ollama run qwen3:4bRead our Ollama review →HuggingFace
Original weights
Source repository — direct quantization required.
Hardware that runs this
Cards with enough VRAM for at least one quantization of Qwen 3 4B.
Models worth comparing
Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.
Frequently asked
What's the minimum VRAM to run Qwen 3 4B?
Can I use Qwen 3 4B commercially?
What's the context length of Qwen 3 4B?
How do I install Qwen 3 4B with Ollama?
Source: huggingface.co/Qwen/Qwen3-4B
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.
Related — keep moving
Verify Qwen 3 4B runs on your specific hardware before committing money.