other
8B parameters
Restricted
Reviewed November 2026

Aya 23 8B

Cohere's multilingual research model covering 23 languages. CC-BY-NC — research only.

License: CC-BY-NC 4.0·Released May 23, 2024·Context: 8,192 tokens

Overview

Cohere's multilingual research model covering 23 languages. CC-BY-NC — research only.

Family & lineage

How this model relates to others in its lineage. Family members share architecture and training-data roots; parent / children edges record direct distillation or fine-tune relationships.

Family siblings (aya)
Distilled / fine-tuned from this

Strengths

  • 23 languages
  • Research-friendly

Weaknesses

  • Non-commercial license

Quantization variants

Each quantization trades model quality for file size and VRAM. Q4_K_M is the most popular starting point.

QuantizationFile sizeVRAM required
Q4_K_M5.0 GB8 GB

Get the model

HuggingFace

Original weights

huggingface.co/CohereLabs/aya-23-8B

Source repository — direct quantization required.

Hardware that runs this

Cards with enough VRAM for at least one quantization of Aya 23 8B.

Compare alternatives

Models worth comparing

Same parameter band, plus what's one tier above and below — so you can decide what actually fits your hardware.

Frequently asked

What's the minimum VRAM to run Aya 23 8B?

8GB of VRAM is enough to run Aya 23 8B at the Q4_K_M quantization (file size 5.0 GB). Higher-quality quantizations need more.

Can I use Aya 23 8B commercially?

Aya 23 8B is released under the CC-BY-NC 4.0, which has restrictions for commercial use. Review the license terms before using it in a product.

What's the context length of Aya 23 8B?

Aya 23 8B supports a context window of 8,192 tokens (about 8K).

Source: huggingface.co/CohereLabs/aya-23-8B

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify model claims.

Related — keep moving

Before you buy

Verify Aya 23 8B runs on your specific hardware before committing money.