Multi-Query Attention (MQA)

Also known as: multi-query attention

Definition pending

We've cataloged "Multi-Query Attention (MQA)" but haven't written a full definition yet. Definitions are hand-curated rather than auto-generated, so it takes time to cover every term.

Want this one prioritized? Email us and we'll bump it.

Related terms

KV Cache Multi-Head Attention

stub

Grouped-Query Attention (GQA)

stub

Buyer guides

Best GPU for local AI →
Best laptop for local AI →
Best Mac for local AI →

When it doesn't work

CUDA out of memory →
Ollama running slowly →
ROCm not detected →