other
7B parameters
Commercial OK
Multimodal
Reviewed October 2026

LLaVA 1.6 Mistral 7B

LLaVA 1.6 on Mistral 7B base. Apache 2.0 vision-language with strong OCR.

License: Apache 2.0·Released Jan 30, 2024·Context: 32,768 tokens

Overview

LLaVA 1.6 on Mistral 7B base. Apache 2.0 vision-language with strong OCR.

Family & lineage

How this model relates to others in its lineage. Family members share architecture and training-data roots; parent / children edges record direct distillation or fine-tune relationships.

Distilled / fine-tuned from this

Strengths

  • Apache 2.0
  • Strong OCR

Weaknesses

  • Newer LLaVA-OneVision supersedes

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M4.5 GB7 GB

Get the model

HuggingFace

Original weights

huggingface.co/liuhaotian/llava-v1.6-mistral-7b

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of LLaVA 1.6 Mistral 7B.

Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Frequently asked

What's the minimum VRAM to run LLaVA 1.6 Mistral 7B?

7GB of VRAM is enough to run LLaVA 1.6 Mistral 7B at the Q4_K_M quantization (file size 4.5 GB). Higher-quality quantizations need more.

Can I use LLaVA 1.6 Mistral 7B commercially?

Yes — LLaVA 1.6 Mistral 7B ships under the Apache 2.0, which permits commercial use. Always read the license text before deployment.

What's the context length of LLaVA 1.6 Mistral 7B?

LLaVA 1.6 Mistral 7B supports a context window of 32,768 tokens (about 33K).

Does LLaVA 1.6 Mistral 7B support images?

Yes — LLaVA 1.6 Mistral 7B is multimodal and accepts text + vision inputs. Vision support requires a runner that handles its image-conditioning architecture.

Source: huggingface.co/liuhaotian/llava-v1.6-mistral-7b

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.

Related — keep moving

Before you buy

Verify LLaVA 1.6 Mistral 7B runs on your specific hardware before committing money.