AMD Radeon RX 6700 XT
12 GB RDNA 2 at the $280 used tier. ROCm officially supported. The VRAM headroom matters — fits 13B Q4 comfortably. ~50-65 tok/s on 7B Q4. Strong AMD value pick for the 'more VRAM than NVIDIA at this price' decision shape.
Affiliate disclosure: as an Amazon Associate and partner of other retailers, we earn from qualifying purchases. The verdict on this page is our editorial opinion; affiliate links never influence what we recommend.
Sub-scores sum to 364 / 1000. Headline = 364 × 0.70 (Estimated-confidence discount) = 255. This is an algorithmic performance-tier score — distinct from, and often lower than, the editorial “Our verdict” below, which weighs value and real-world fit (especially for hardware we haven’t measured yet). How scoring works →
Extrapolated from 384 GB/s bandwidth — 38.4 tok/s estimated. No measured benchmarks yet.
Plain-English: Comfortable at 14B and below — coding agent feels deliberate.
Verdicts extrapolated from catalog VRAM + bandwidth + ecosystem flags. Hover any chip for the rationale. Want measured numbers? Submit your own run with runlocalai-bench --submit.
The RX 6700 XT is for the operator who needs 12 GB VRAM at a sub-$300 used price and is willing to work within ROCm's software ecosystem. It fits 13B Q4 comfortably and runs 7B Q4 at an estimated 42-60 tok/s, making it a solid mid-range inference card. The 384 GB/s bandwidth also handles 30B Q4 models at ~15-20 tok/s, but 70B models are out of reach. ROCm support is official, but PyTorch and vLLM integration can be less polished than CUDA, and some inference frameworks may lack full optimization. Pass on this card if the workload requires 70B models, needs CUDA-exclusive features, or demands the plug-and-play experience of NVIDIA cards. At $280 used, this is a strong AMD value pick for the 'more VRAM than NVIDIA at this price' decision shape.
›Why this rating
The 12 GB VRAM at $280 is a compelling value for local AI inference, especially for 13B models. However, the ROCm software stack and lower bandwidth compared to similarly priced used NVIDIA cards (e.g., RTX 3060 12GB) limit its versatility and peak performance.
Overview
12 GB RDNA 2 at the $280 used tier. ROCm officially supported. The VRAM headroom matters — fits 13B Q4 comfortably. ~50-65 tok/s on 7B Q4. Strong AMD value pick for the 'more VRAM than NVIDIA at this price' decision shape.
Some links above are affiliate links. We may earn a commission at no extra cost to you. How we make money.
Specs
| VRAM | 12 GB |
| Power draw (peak) | 230 W |
| Released | 2021 |
| MSRP | $479 |
| Backends | ROCm Vulkan |
Models that fit
Open-weight models small enough to run on AMD Radeon RX 6700 XT with usable context.
Frequently asked
What models can AMD Radeon RX 6700 XT run?
Does AMD Radeon RX 6700 XT support CUDA?
How much does AMD Radeon RX 6700 XT cost?
Where next?
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify hardware specifications.