UNIT · AMD · GPU
16 GB VRAMhighReviewed November 2026

AMD Radeon RX 6800

No editorial image yet — generic vendor mark shown. Credentials in spec table below.

16 GB RDNA 2 — the AMD answer to the 4070 12 GB question. Comfortable for any 7B/13B model + 32B Q4 with offload. AMD does not list this card as supported for ROCm, though Ollama lists it under its ROCm backend on Linux. The card to consider when VRAM matters more than raw inference speed.

Released 2020·Launch MSRP $579 (2020) · Now sells well below its launch price on the used market.·512 GB/s memory bandwidth
RUNLOCALAI SCORE
See full leaderboard →
304/ 1000
CC-tier
Estimated
Throughput
148/ 500
VRAM-fit
140/ 200
Ecosystem
130/ 200
Efficiency
16/ 100

Sub-scores sum to 434 / 1000. Headline = 434 × 0.70 (Estimated-confidence discount) = 304. This is an algorithmic performance-tier score — distinct from, and often lower than, the editorial “Our verdict” below, which weighs value and real-world fit (especially for hardware we haven’t measured yet). How scoring works →

Extrapolated from 512 GB/s bandwidth — 51.2 tok/s estimated. No measured benchmarks yet.

WORKLOAD FIT
Try other hardware →

Plain-English: Comfortable at 14B and below — snappy enough for a coding agent.

7B chat✓
Comfortable
14B chat✓
Comfortable
32B chat✗
Doesn't fit
70B chat✗
Doesn't fit
Coding agent✓
Comfortable
Vision (≤8B VLM)~
Tight
Long context (32K)✓
Comfortable
✓Comfortable — fits with headroom
~Tight — works, no slack
△Marginal — needs aggressive quant
✗Doesn't fit usefully

Verdicts extrapolated from catalog VRAM + bandwidth + ecosystem flags. Hover any chip for the rationale. Want measured numbers? Submit your own run with runlocalai-bench --submit.

BLK · OVERVIEW

Overview

16 GB RDNA 2 — the AMD answer to the 4070 12 GB question. Comfortable for any 7B/13B model + 32B Q4 with offload. AMD does not list this card as supported for ROCm, though Ollama lists it under its ROCm backend on Linux. The card to consider when VRAM matters more than raw inference speed.

Retailers we'd check:Amazon

Search-fallback link — editorial hasn't yet curated a retailer URL for this card. Check the current price with the retailer.

Some links above are affiliate links. We may earn a commission at no extra cost to you. How we make money.

BLK · SPECS

Specs

VRAM16 GB
Power draw (peak)250 W
Released2020
MSRP$579
Backends
ROCm
Vulkan

Models that fit

Open-weight models small enough to run on AMD Radeon RX 6800 with usable context.

all-MiniLM-L6-v2
0.022B · other · fits by VRAM, no benchmark yet
Nomic Embed Text v1.5
0.137B · other · fits by VRAM, no benchmark yet
Kokoro 82M
0.082B · other · fits by VRAM, no benchmark yet
Llama 3.1 8B Instruct
8B · llama · fits by VRAM, no benchmark yet
BGE Large EN v1.5
0.335B · other · fits by VRAM, no benchmark yet
Qwen 3 0.6B
0.6B · qwen · fits by VRAM, no benchmark yet
all-mpnet-base-v2
0.109B · other · fits by VRAM, no benchmark yet
XTTS v2
0.46B · other · fits by VRAM, no benchmark yet

Frequently asked

What models can AMD Radeon RX 6800 run?

With 16GB VRAM, the AMD Radeon RX 6800 runs models up to 14B in 4-bit, or 7B at higher quantizations. See the model list below for tested combinations.

Does AMD Radeon RX 6800 support CUDA?

No — AMD Radeon RX 6800 is an AMD card. Use ROCm (Linux) or the Vulkan backend in llama.cpp instead. CUDA-only tools won't work.

How much does AMD Radeon RX 6800 cost?

The AMD Radeon RX 6800 launched at an MSRP of $579 in 2020. Now sells well below its launch price on the used market. Retail prices change often, so check the current price with a retailer before you buy.

Where next?

Buyer guides
Troubleshooting

Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify hardware specifications.