RunLocalAI
mistral
123B parameters
Restricted

Mistral Large 2 (123B)

Mistral's flagship dense model. Open weights but restricted commercial license — research and non-commercial only.

License: Mistral Research License·Released Jul 24, 2024·Context: 131,072 tokens

Overview

Mistral's flagship dense model. Open weights but restricted commercial license — research and non-commercial only.

Strengths

  • Top-tier dense quality
  • 128K context
  • Strong multilingual

Weaknesses

  • Non-commercial license
  • Workstation-only

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M73.0 GB88 GB

Get the model

Ollama

One-line install

ollama run mistral-large:123bRead our Ollama review →

HuggingFace

Original weights

huggingface.co/mistralai/Mistral-Large-Instruct-2407

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of Mistral Large 2 (123B).

NVIDIA GB200 NVL72
13824GB · nvidia
AMD Instinct MI355X
288GB · amd
AMD Instinct MI325X
256GB · amd
NVIDIA B200
192GB · nvidia
AMD Instinct MI300X
192GB · amd
NVIDIA H100 NVL
188GB · nvidia
NVIDIA H200
141GB · nvidia
AMD Instinct MI250X
128GB · amd
Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Step up
More capable — bigger memory footprint
No verdicted models in the next tier up yet.

Frequently asked

What's the minimum VRAM to run Mistral Large 2 (123B)?

88GB of VRAM is enough to run Mistral Large 2 (123B) at the Q4_K_M quantization (file size 73.0 GB). Higher-quality quantizations need more.

Can I use Mistral Large 2 (123B) commercially?

Mistral Large 2 (123B) is released under the Mistral Research License, which has restrictions for commercial use. Review the license terms before using it in a product.

What's the context length of Mistral Large 2 (123B)?

Mistral Large 2 (123B) supports a context window of 131,072 tokens (about 131K).

How do I install Mistral Large 2 (123B) with Ollama?

Run `ollama pull mistral-large:123b` to download, then `ollama run mistral-large:123b` to start a chat session. The default quantization is Q4_K_M.

Source: huggingface.co/mistralai/Mistral-Large-Instruct-2407

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.