AMD Radeon RX 6750 XT
Refreshed 6700 XT with faster GDDR6 (432 GB/s). 12 GB VRAM fits 13B Q4 comfortably. ROCm officially supported. ~55-75 tok/s on 7B Q4. Strong AMD value pick at the $300-360 used tier — more VRAM than NVIDIA at this price.
Affiliate disclosure: as an Amazon Associate and partner of other retailers, we earn from qualifying purchases. The verdict on this page is our editorial opinion; affiliate links never influence what we recommend.
Sub-scores sum to 379 / 1000. Headline = 379 × 0.70 (Estimated-confidence discount) = 265. This is an algorithmic performance-tier score — distinct from, and often lower than, the editorial “Our verdict” below, which weighs value and real-world fit (especially for hardware we haven’t measured yet). How scoring works →
Extrapolated from 432 GB/s bandwidth — 43.2 tok/s estimated. No measured benchmarks yet.
Plain-English: Comfortable at 14B and below — snappy enough for a coding agent.
Verdicts extrapolated from catalog VRAM + bandwidth + ecosystem flags. Hover any chip for the rationale. Want measured numbers? Submit your own run with runlocalai-bench --submit.
This card is for the operator who wants to run 13B Q4 models comfortably and values VRAM over peak throughput, especially at the sub-$350 used price point. It handles 7B Q4 at 55-75 tok/s and 13B Q4 at 30-40 tok/s, making it viable for interactive chat and local inference. The 12 GB VRAM fits 13B Q4 with room for context, but 30B models are out of reach—even Q4 quantizations exceed VRAM. ROCm support is official, but PyTorch/Transformers integration may lag behind NVIDIA's CUDA ecosystem. Pass if you need to run 30B+ models or require seamless software compatibility without tinkering. At $320 used, this is a strong value for the VRAM-to-price ratio, beating NVIDIA equivalents in memory capacity.
›Why this rating
The RX 6750 XT offers excellent VRAM for the price, enabling 13B models comfortably. However, software ecosystem maturity and inability to run larger models cap its score. It's a solid mid-range pick for AMD-focused builds.
Overview
Refreshed 6700 XT with faster GDDR6 (432 GB/s). 12 GB VRAM fits 13B Q4 comfortably. ROCm officially supported. ~55-75 tok/s on 7B Q4. Strong AMD value pick at the $300-360 used tier — more VRAM than NVIDIA at this price.
Some links above are affiliate links. We may earn a commission at no extra cost to you. How we make money.
Specs
| VRAM | 12 GB |
| Power draw (peak) | 250 W |
| Released | 2022 |
| MSRP | $549 |
| Backends | ROCm Vulkan |
Models that fit
Open-weight models small enough to run on AMD Radeon RX 6750 XT with usable context.
Frequently asked
What models can AMD Radeon RX 6750 XT run?
Does AMD Radeon RX 6750 XT support CUDA?
How much does AMD Radeon RX 6750 XT cost?
Where next?
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify hardware specifications.