Every catalog hardware unit ranked by composite score (0–1000): measured tok/s, VRAM fit, ecosystem support, perf-per-watt. 2 of 128 ranks anchored to a measured benchmark — the rest are honestly flagged as extrapolated or estimated.
Methodology: /methodology · Run your own: curl -fsSL runlocalai.co/bench.mjs -o bench.mjs && node bench.mjs
103 units shown · sorted by score
| # | Hardware | Tier | Score | Data |
|---|---|---|---|---|
| 1 | NVIDIA GeForce GTX 1080 nvidia · mid · 8GB | D | 286 | Estimated |
| 2 | NVIDIA RTX PRO 6000 Blackwell nvidia · workstation · 96GB | D | 280 | Estimated |
| 3 | NVIDIA GB200 NVL72 nvidia · workstation · 13824GB | D | 280 | Estimated |
| 4 | NVIDIA B200 nvidia · workstation · 192GB | D | 280 | Estimated |
| 5 | NVIDIA H200 nvidia · workstation · 141GB | D | 280 | Estimated |
| 6 | NVIDIA H100 NVL nvidia · workstation · 188GB | D | 280 | Estimated |
| 7 | NVIDIA RTX 6000 Ada Generation nvidia · workstation · 48GB | D | 273 | Estimated |
| 8 | NVIDIA L40S nvidia · workstation · 48GB | D | 273 | Estimated |
| 9 | NVIDIA L40 nvidia · workstation · 48GB | D | 273 | Estimated |
| 10 | NVIDIA H100 PCIe nvidia · workstation · 80GB | D | 273 | Estimated |
| 11 | NVIDIA A40 nvidia · workstation · 48GB | D | 273 | Estimated |
| 12 | NVIDIA RTX A6000 (Ampere) nvidia · workstation · 48GB | D | 273 | Estimated |
| 13 | NVIDIA A100 80GB SXM nvidia · workstation · 80GB | D | 273 | Estimated |
| 14 | NVIDIA H100 SXM nvidia · workstation · 80GB | D | 273 | Estimated |
| 15 | NVIDIA GeForce GTX 1070 nvidia · mid · 8GB | D | 270 | Estimated |
| 16 | NVIDIA GeForce GTX 1070 Ti nvidia · mid · 8GB | D | 268 | Estimated |
| 17 | AMD Radeon RX 6750 XT amd · high · 12GB | D | 265 | Estimated |
| 18 | NVIDIA GeForce RTX 3050 nvidia · entry · 8GB | D | 263 | Estimated |
| 19 | NVIDIA GeForce GTX 1660 Super nvidia · mid · 6GB | D | 261 | Estimated |
| 20 | NVIDIA GeForce RTX 3090 Ti nvidia · enthusiast · 24GB | D | 259 | Estimated |
| 21 | NVIDIA GeForce RTX 5090 Mobile nvidia · enthusiast · 24GB | D | 259 | Estimated |
| 22 | NVIDIA A100 40GB nvidia · workstation · 40GB | D | 259 | Estimated |
| 23 | NVIDIA L4 nvidia · workstation · 24GB | D | 259 | Estimated |
| 24 | NVIDIA RTX 5000 Ada Generation nvidia · workstation · 32GB | D | 259 | Estimated |
| 25 | Razer Blade 16 (2025, RTX 5090 Mobile) nvidia · enthusiast · 24GB | D | 259 | Estimated |
| 26 | ASUS ROG Strix Scar 18 (RTX 5090 Mobile) nvidia · enthusiast · 24GB | D | 259 | Estimated |
| 27 | NVIDIA RTX A5000 nvidia · workstation · 24GB | D | 259 | Estimated |
| 28 | NVIDIA GeForce RTX 2060 nvidia · mid · 6GB | D | 257 | Estimated |
| 29 | AMD Radeon RX 6700 XT amd · high · 12GB | D | 255 | Estimated |
| 30 | NVIDIA GeForce GTX 1660 Ti nvidia · mid · 6GB | D | 247 | Estimated |
| 31 | NVIDIA GeForce RTX 5070 Ti nvidia · high · 16GB | D | 238 | Estimated |
| 32 | NVIDIA GeForce RTX 4080 nvidia · high · 16GB | D | 238 | Estimated |
| 33 | NVIDIA GeForce RTX 4070 Ti Super nvidia · high · 16GB | D | 238 | Estimated |
| 34 | NVIDIA GeForce RTX 5060 Ti 16GB nvidia · mid · 16GB | D | 238 | Estimated |
| 35 | Lenovo Legion 5 Pro Gen 7 (RTX 3080 16GB) nvidia · high · 16GB | D | 238 | Estimated |
| 36 | NVIDIA GeForce RTX 4090 Mobile nvidia · enthusiast · 16GB | D | 238 | Estimated |
| 37 | AMD Instinct MI300X amd · workstation · 192GB | D | 231 | Estimated |
| 38 | AMD Instinct MI250X amd · workstation · 128GB | D | 231 | Estimated |
| 39 | AMD Instinct MI355X amd · workstation · 288GB | D | 231 | Estimated |
| 40 | AMD Instinct MI325X amd · workstation · 256GB | D | 231 | Estimated |
| 41 | AMD Instinct MI300A (APU) amd · workstation · 128GB | D | 231 | Estimated |
| 42 | AMD Instinct MI210 amd · workstation · 64GB | D | 224 | Estimated |
| 43 | NVIDIA GeForce RTX 3050 Ti (Mobile) nvidia · mobile · 4GB | D | 224 | Estimated |
| 44 | Apple M4 (iPad Pro) apple · mobile | D | 223 | Estimated |
| 45 | NVIDIA GeForce GTX 1650 Super nvidia · entry · 4GB | D | 221 | Estimated |
| 46 | NVIDIA GeForce GTX 1060 6GB nvidia · entry · 6GB | D | 218 | Estimated |
| 47 | NVIDIA GeForce GTX 1660 nvidia · mid · 6GB | D | 218 | Estimated |
| 48 | NVIDIA GeForce GTX 1060 3GB nvidia · entry · 3GB | D | 218 | Estimated |
| 49 | NVIDIA GeForce RTX 4070 Ti nvidia · high · 12GB | D | 217 | Estimated |
| 50 | NVIDIA GeForce RTX 4070 nvidia · mid · 12GB | D | 217 | Estimated |
| 51 | NVIDIA GeForce RTX 3080 12GB nvidia · high · 12GB | D | 217 | Estimated |
| 52 | NVIDIA GeForce RTX 5070 nvidia · mid · 12GB | D | 217 | Estimated |
| 53 | NVIDIA GeForce RTX 4070 Super nvidia · mid · 12GB | D | 217 | Estimated |
| 54 | AMD Radeon RX 5700 XT amd · high · 8GB | D | 214 | Estimated |
| 55 | AMD Radeon RX 6650 XT amd · mid · 8GB | D | 212 | Estimated |
| 56 | AMD Radeon RX 6600 XT amd · mid · 8GB | D | 208 | Estimated |
| 57 | Apple A18 Pro apple · mobile | D | 206 | Estimated |
| 58 | NVIDIA GeForce GTX 1650 nvidia · entry · 4GB | D | 204 | Estimated |
| 59 | Apple A17 Pro apple · mobile | D | 204 | Estimated |
| 60 | AMD Radeon RX 6600 amd · mid · 8GB | D | 202 | Estimated |
| 61 | Apple M3 Ultra apple · enthusiast · 1 bench | D | 200 | Measured-near |
| 62 | NVIDIA GeForce GTX 1050 Ti nvidia · entry · 4GB | D | 198 | Estimated |
| 63 | NVIDIA GeForce RTX 4060 Ti 8GB nvidia · mid · 8GB | D | 196 | Estimated |
| 64 | NVIDIA GeForce RTX 4060 nvidia · entry · 8GB | D | 196 | Estimated |
| 65 | NVIDIA GeForce RTX 3080 10GB nvidia · high · 10GB | D | 196 | Estimated |
| 66 | NVIDIA GeForce RTX 5060 nvidia · entry · 8GB | D | 196 | Estimated |
| 67 | NVIDIA GeForce RTX 3070 nvidia · mid · 8GB | D | 196 | Estimated |
| 68 | NVIDIA GeForce RTX 5060 Ti 8GB nvidia · mid · 8GB | D | 196 | Estimated |
| 69 | AMD Radeon RX 7900 XT amd · enthusiast · 20GB | D | 189 | Estimated |
| 70 | AMD Radeon RX 7800 XT amd · high · 16GB | D | 189 | Estimated |
| 71 | AMD Radeon RX 9070 amd · high · 16GB | D | 189 | Estimated |
| 72 | AMD Radeon RX 7600 XT amd · mid · 16GB | D | 189 | Estimated |
| 73 | AMD Radeon RX 9070 XT amd · high · 16GB | D | 189 | Estimated |
| 74 | AMD Radeon RX 580 8GB amd · mid · 8GB | D | 172 | Estimated |
| 75 | AMD Radeon RX 7700 XT amd · mid · 12GB | D | 168 | Estimated |
| 76 | Intel Gaudi 2 intel · workstation · 96GB | D | 168 | Estimated |
| 77 | Intel Gaudi 3 intel · workstation · 128GB | D | 168 | Estimated |
| 78 | AMD Radeon RX 5500 XT 8GB amd · entry · 8GB | D | 167 | Estimated |
| 79 | AMD Radeon RX 5600 XT amd · mid · 6GB | D | 158 | Estimated |
| 80 | Intel Arc A770 16GB intel · mid · 16GB | D | 154 | Estimated |
| 81 | Framework Laptop 16 (RX 7700S) amd · mid · 8GB | D | 147 | Estimated |
| 82 | NVIDIA DGX Spark (Project Digits) nvidia · workstation | D | 140 | Estimated |
| 83 | Intel Arc B580 intel · mid · 12GB | D | 133 | Estimated |
| 84 | AMD Radeon 880M (Strix Point iGPU) amd · entry | D | 132 | Estimated |
| 85 | AMD Radeon RX 570 amd · entry · 4GB | D | 131 | Estimated |
| 86 | Qualcomm Snapdragon 8 Elite qualcomm · mobile | D | 127 | Estimated |
| 87 | AMD Ryzen AI 9 HX 370 (Strix Point) amd · pc-npu | D | 127 | Estimated |
| 88 | AMD Radeon 780M (Phoenix iGPU) amd · entry | D | 127 | Estimated |
| 89 | Qualcomm Snapdragon 8 Gen 3 qualcomm · mobile | D | 123 | Estimated |
| 90 | Apple M2 Ultra apple · enthusiast | D | 119 | Estimated |
| 91 | Apple M4 Ultra apple · enthusiast | D | 119 | Estimated |
| 92 | Apple M4 Pro apple · high | D | 119 | Estimated |
| 93 | Apple Mac Studio (M3 Ultra) apple · enthusiast | D | 119 | Estimated |
| 94 | MacBook Pro 16" M4 Max apple · enthusiast | D | 119 | Estimated |
| 95 | Apple M2 Max apple · high | D | 119 | Estimated |
| 96 | Apple M1 Max apple · high | D | 119 | Estimated |
| 97 | Apple M1 Ultra apple · enthusiast | D | 119 | Estimated |
| 98 | Intel Arc 140V (Lunar Lake iGPU) intel · entry | D | 115 | Estimated |
| 99 | Intel Arc B570 intel · mid · 10GB | D | 112 | Estimated |
| 100 | Google Tensor G4 google · mobile | D | 106 | Estimated |
| 101 | Intel Core Ultra 7 258V (Lunar Lake) intel · pc-npu | D | 100 | Estimated |
| 102 | Qualcomm Snapdragon X Plus qualcomm · mid | D | 28 | Estimated |
| 103 | Qualcomm Snapdragon X Elite qualcomm · high | D | 28 | Estimated |
Steady-state tok/s on a representative 7B/8B Q4 model. Measured from real benchmark rows, or extrapolated from VRAM bandwidth × runtime-stack efficiency.
How comfortably the rig holds 7B / 32B / 70B class models. Apple unified memory counts; NPU/SoC system RAM counts.
CUDA / MLX / ROCm / Vulkan reach. Real-world friction the operator hits when installing tools.
Tok/s per watt. Mobile / NPU class scores well; dense desktop GPUs trade efficiency for absolute throughput.
A confidence multiplier (1.0 measured · 0.85 extrapolated · 0.7 estimated) discounts the headline so we don't pretend to know more than we do. Score is recomputed on every page load against the latest catalog + benchmark data — submit your own run with runlocalai-bench --submit --hardware your-rig to firm up the numbers.