InternLM 2.5 7B Chat
InternLM 2.5 mid-size chat. Code is Apache-2.0; the weights allow free commercial use after a license application; strong on math and Chinese.
Overview
InternLM 2.5 mid-size chat. Code is Apache-2.0; the weights allow free commercial use after a license application; strong on math and Chinese.
Strengths
- Free commercial use of weights after a license application
- Math + Chinese
Weaknesses
- Qwen 2.5 7B is the larger-community alternative
Quantization variants
Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.
| Quantization | File size | VRAM required |
|---|---|---|
| Q4_K_M | 4.4 GB | 6 GB |
Get the model
HuggingFace
Original weights
Source repository — direct quantization required.
Hardware that runs this
Cards with enough VRAM for at least one quantization of InternLM 2.5 7B Chat.
Models worth comparing
Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.
Frequently asked
What's the minimum VRAM to run InternLM 2.5 7B Chat?
Can I use InternLM 2.5 7B Chat commercially?
What's the context length of InternLM 2.5 7B Chat?
Source: huggingface.co/internlm/internlm2_5-7b-chat
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.
Related — keep moving
Verify InternLM 2.5 7B Chat runs on your specific hardware before committing money.