nvidia
GPU
48GB VRAM
workstation
NVIDIA RTX A6000 (Ampere)
Ampere-gen workstation card with 48GB. Common in AI labs; used market is reasonable for 48GB at this point.
Released 2020·~$3500 street
Overview
Ampere-gen workstation card with 48GB. Common in AI labs; used market is reasonable for 48GB at this point.
Where to buy
Geo-routed to your region. Approx. $3500.
Some links above are affiliate links. We may earn a commission at no extra cost to you. How we make money.
Specs
| VRAM | 48 GB |
| Power draw | 300 W |
| Released | 2020 |
| MSRP | $4650 |
| Backends | CUDA Vulkan |
Models that fit
Open-weight models small enough to run on NVIDIA RTX A6000 (Ampere) with usable context.
Frequently asked
What models can NVIDIA RTX A6000 (Ampere) run?
With 48GB VRAM, the NVIDIA RTX A6000 (Ampere) runs 70B models in 4-bit quantization, plus everything smaller. See the model list below for tested combinations.
Does NVIDIA RTX A6000 (Ampere) support CUDA?
Yes — NVIDIA RTX A6000 (Ampere) is an NVIDIA card with full CUDA support, the most mature local-AI backend. llama.cpp, Ollama, vLLM, and ExLlamaV2 all run natively.
How much does NVIDIA RTX A6000 (Ampere) cost?
Current street price for NVIDIA RTX A6000 (Ampere) is around $3500 (MSRP $4650). Prices vary by region and supply.
Reviewed by RunLocalAI Editorial. See our editorial policy for how we research and verify hardware specifications.