BLK · LEADERBOARD

RunLocalAI Score

Every catalog hardware unit ranked by composite score (0–1000): measured tok/s, VRAM fit, ecosystem support, perf-per-watt. 2 of 157 ranks anchored to a measured benchmark — the rest are honestly flagged as extrapolated or estimated.

Methodology: /methodology · Run your own: curl -fsSL runlocalai.co/bench.mjs -o bench.mjs && node bench.mjs

Vendor:All amd apple google intel nvidia other qualcomm

VRAM:All ≤8GB 9–16GB 17–24GB 25–48GB 49–96GB 97GB+

Tier:All S A B C D

Data:All Measured Measured-near Community Extrapolated Estimated

157 units shown · sorted by score

#	Hardware	Tier	Score	Throughput	VRAM-fit	Ecosystem	Efficiency	Data
1	NVIDIA H20 (96GB) nvidia · workstation · 96GB	B	697	500	200	200	96	Estimated
2	NVIDIA H200 NVL (PCIe) nvidia · workstation · 141GB	B	684	500	200	200	77	Estimated
3	NVIDIA B200 nvidia · workstation · 192GB	B	684	500	200	200	77	Estimated
4	NVIDIA H200 nvidia · workstation · 141GB	B	676	500	200	200	66	Estimated
5	NVIDIA B300 (Blackwell Ultra) nvidia · workstation · 288GB	B	669	500	200	200	55	Estimated
6	NVIDIA H100 NVL nvidia · workstation · 188GB	B	663	500	200	200	47	Estimated
7	NVIDIA H100 PCIe nvidia · workstation · 80GB	B	662	500	190	200	56	Estimated
8	NVIDIA A100 80GB SXM nvidia · workstation · 80GB	B	657	500	190	200	49	Estimated
9	NVIDIA H100 SXM nvidia · workstation · 80GB	B	655	500	190	200	46	Estimated
10	NVIDIA RTX PRO 6000 Blackwell nvidia · workstation · 96GB	B	650	500	200	200	29	Estimated
11	NVIDIA A100 40GB nvidia · workstation · 40GB	B	635	500	170	200	37	Estimated
12	NVIDIA GB200 NVL72 nvidia · workstation · 13824GB	B	631	500	200	200	1	Estimated
13	NVIDIA GeForce RTX 5090 nvidia · enthusiast · 32GB	B	630	500	170	200	30	Estimated
14	AMD Instinct MI355X amd · workstation · 288GB	B	626	500	200	130	64	Estimated
15	AMD Instinct MI350X amd · workstation · 288GB	B	626	500	200	130	64	Estimated
16	AMD Instinct MI300X amd · workstation · 192GB	B	621	500	200	130	57	Estimated
17	AMD Instinct MI300A (APU) amd · workstation · 128GB	B	620	500	200	130	56	Estimated
18	Apple M4 Ultra apple · enthusiast	B	615	447	200	170	62	Estimated
19	AMD Instinct MI325X amd · workstation · 256GB	B	615	500	200	130	48	Estimated
20	AMD Instinct MI250X amd · workstation · 128GB	B	614	500	200	130	47	Estimated
21	NVIDIA GeForce RTX 5080 nvidia · enthusiast · 16GB · 12 bench	B	596	238	140	200	18	Measured
22	AMD Instinct MI210 amd · workstation · 64GB	B	587	475	190	130	44	Estimated
23	Intel Gaudi 2 intel · workstation · 96GB	B	536	500	200	40	26	Estimated
24	Intel Gaudi 3 intel · workstation · 128GB	B	536	500	200	40	26	Estimated
25	NVIDIA RTX 4090 48GB (China-mod) nvidia · workstation · 48GB	B	534	351	190	200	22	Estimated
26	Apple M1 Ultra apple · enthusiast	B	529	325	200	170	60	Estimated
27	NVIDIA RTX 5000 PRO Blackwell 48GB nvidia · workstation · 48GB	B	529	334	190	200	31	Estimated
28	NVIDIA RTX 6000 Ada Generation nvidia · workstation · 48GB	B	529	334	190	200	31	Estimated
29	Apple M3 Ultra apple · enthusiast	B	522	325	200	170	50	Estimated
30	Apple M2 Ultra apple · enthusiast	B	522	325	200	170	50	Estimated
31	NVIDIA GeForce RTX 3090 Ti nvidia · enthusiast · 24GB	B	520	351	170	200	22	Estimated
32	NVIDIA GeForce RTX 4090 nvidia · enthusiast · 24GB	B	520	351	170	200	22	Estimated
33	NVIDIA GeForce RTX 5090 Mobile nvidia · enthusiast · 24GB	B	512	312	170	200	49	Estimated
34	Apple Mac Studio (M3 Ultra) apple · enthusiast	B	512	325	200	170	36	Estimated
35	NVIDIA RTX PRO 4500 Blackwell nvidia · workstation · 32GB	B	507	312	170	200	43	Estimated
36	NVIDIA GeForce RTX 3090 nvidia · enthusiast · 24GB	B	505	326	170	200	26	Estimated
37	NVIDIA L40 nvidia · workstation · 48GB	B	503	301	190	200	28	Estimated
38	NVIDIA L40S nvidia · workstation · 48GB	B	500	301	190	200	24	Estimated
39	NVIDIA GeForce RTX 3080 16GB (Mobile) nvidia · high · 16GB · 27 bench	C	487	126	140	200	21	Measured
40	NVIDIA RTX A6000 (Ampere) nvidia · workstation · 48GB	C	477	267	190	200	25	Estimated
41	NVIDIA GeForce RTX 5070 Ti nvidia · high · 16GB	C	477	312	140	200	29	Estimated
42	NVIDIA RTX A5000 nvidia · workstation · 24GB	C	468	267	170	200	32	Estimated
43	NVIDIA A40 nvidia · workstation · 48GB	C	458	242	190	200	22	Estimated
44	Apple M4 Max apple · enthusiast	C	457	222	200	170	61	Estimated
45	NVIDIA GeForce RTX 3080 Ti nvidia · enthusiast · 12GB	C	456	317	110	200	25	Estimated
46	NVIDIA GeForce RTX 3080 12GB nvidia · high · 12GB	C	456	317	110	200	25	Estimated
47	NVIDIA RTX PRO 4000 Blackwell nvidia · workstation · 24GB	C	455	234	170	200	46	Estimated
48	MacBook Pro 16" M4 Max apple · enthusiast	C	445	222	200	170	44	Estimated
49	Apple Mac Studio (M4 Max) apple · enthusiast	C	438	222	190	170	44	Estimated
50	NVIDIA GeForce RTX 4080 Super nvidia · high · 16GB	C	433	256	140	200	22	Estimated
51	NVIDIA GeForce RTX 4080 nvidia · high · 16GB	C	428	250	140	200	22	Estimated
52	AMD Radeon RX 7900 XTX amd · enthusiast · 24GB	C	420	278	170	130	22	Estimated
53	NVIDIA GeForce RTX 4070 Ti Super nvidia · high · 16GB	C	418	234	140	200	23	Estimated
54	NVIDIA RTX 5000 Ada Generation nvidia · workstation · 32GB	C	414	200	170	200	22	Estimated
55	NVIDIA RTX 2080 Ti 22GB (China-mod) nvidia · mid · 22GB	C	405	214	140	200	24	Estimated
56	Apple M1 Max apple · high	C	404	162	170	170	75	Estimated
57	Apple M2 Max apple · high	C	400	162	190	170	50	Estimated
58	NVIDIA GeForce RTX 4090 Mobile nvidia · enthusiast · 16GB	C	400	200	140	200	32	Estimated
59	NVIDIA GeForce RTX 5070 nvidia · mid · 12GB	C	399	234	110	200	26	Estimated
60	Apple M3 Max apple · enthusiast	C	398	162	190	170	47	Estimated
61	NVIDIA GeForce RTX 3080 10GB nvidia · high · 10GB	C	397	264	80	200	23	Estimated
62	AMD Radeon RX 7900 XT amd · enthusiast · 20GB	C	365	232	140	130	20	Estimated
63	NVIDIA GeForce RTX 5060 Ti 16GB nvidia · mid · 16GB	C	364	156	140	200	24	Estimated
64	NVIDIA GeForce RTX 2080 Ti nvidia · enthusiast · 11GB	C	363	214	80	200	24	Estimated
65	NVIDIA L4 nvidia · workstation · 24GB	C	360	104	170	200	40	Estimated
66	NVIDIA GeForce RTX 3070 Ti nvidia · high · 8GB	C	358	212	80	200	20	Estimated
67	NVIDIA GeForce RTX 4070 nvidia · mid · 12GB	C	356	175	110	200	24	Estimated
68	NVIDIA GeForce RTX 4070 Super nvidia · mid · 12GB	C	355	175	110	200	22	Estimated
69	Apple M4 Pro apple · high	C	351	111	170	170	51	Estimated
70	NVIDIA GeForce RTX 4070 Ti nvidia · high · 12GB	C	351	175	110	200	17	Estimated
71	Apple Mac Mini (M4 Pro) apple · high	C	340	111	170	170	34	Estimated
72	AMD Radeon RX 9060 XT amd · mid · 16GB	C	339	186	140	130	28	Estimated
73	NVIDIA GeForce RTX 5070 Laptop GPU nvidia · high · 12GB	C	337	134	110	200	37	Estimated
74	AMD Radeon RX 9070 XT amd · high · 16GB	C	332	187	140	130	17	Estimated
75	AMD Radeon RX 9070 amd · high · 16GB	C	332	181	140	130	23	Estimated
76	NVIDIA GeForce RTX 2080 Super nvidia · high · 8GB	C	330	173	80	200	19	Estimated
77	AMD Radeon RX 7800 XT amd · high · 16GB	C	329	181	140	130	19	Estimated
78	NVIDIA GeForce GTX 1080 Ti nvidia · high · 11GB	C	327	168	80	200	19	Estimated
79	NVIDIA GeForce RTX 5060 nvidia · entry · 8GB	C	326	156	80	200	29	Estimated
80	NVIDIA GeForce RTX 2060 Super nvidia · mid · 8GB	C	323	156	80	200	25	Estimated
81	NVIDIA GeForce RTX 2070 nvidia · high · 8GB	C	323	156	80	200	25	Estimated
82	NVIDIA GeForce RTX 5060 Ti 8GB nvidia · mid · 8GB	C	322	156	80	200	24	Estimated
83	NVIDIA GeForce RTX 3060 Ti nvidia · high · 8GB	C	321	156	80	200	22	Estimated
84	NVIDIA GeForce RTX 4060 Ti 16GB nvidia · mid · 16GB	C	320	100	140	200	17	Estimated
85	NVIDIA GeForce RTX 3060 12GB nvidia · mid · 12GB	C	319	125	110	200	20	Estimated
86	NVIDIA GeForce RTX 3070 nvidia · mid · 8GB	C	319	156	80	200	20	Estimated
87	AMD Radeon RX 7900 GRE amd · high · 16GB	C	319	167	140	130	18	Estimated
88	NVIDIA GeForce RTX 2070 Super nvidia · high · 8GB	C	319	156	80	200	20	Estimated
89	AMD Radeon RX 6950 XT amd · enthusiast · 16GB	C	316	167	140	130	14	Estimated
90	AMD Radeon RX 6800 amd · high · 16GB	C	304	148	140	130	16	Estimated
91	AMD Radeon RX 6800 XT amd · enthusiast · 16GB	C	302	148	140	130	14	Estimated
92	AMD Radeon RX 6900 XT amd · enthusiast · 16GB	C	302	148	140	130	14	Estimated
93	NVIDIA GeForce RTX 5050 nvidia · entry · 8GB	D	291	111	80	200	24	Estimated
94	AMD Ryzen AI Max+ 395 (Strix Halo) amd · workstation	D	288	74	190	130	17	Estimated
95	NVIDIA GeForce GTX 1080 nvidia · mid · 8GB	D	286	111	80	200	17	Estimated
96	NVIDIA GeForce RTX 4060 nvidia · entry · 8GB	D	279	95	80	200	23	Estimated
97	NVIDIA GeForce RTX 4060 Ti 8GB nvidia · mid · 8GB	D	278	100	80	200	17	Estimated
98	NVIDIA GeForce GTX 1070 nvidia · mid · 8GB	D	270	89	80	200	16	Estimated
99	NVIDIA GeForce GTX 1070 Ti nvidia · mid · 8GB	D	268	89	80	200	14	Estimated
100	AMD Radeon RX 9070 GRE amd · high · 12GB	D	267	125	110	130	16	Estimated
101	AMD Radeon RX 7700 XT amd · mid · 12GB	D	265	125	110	130	14	Estimated
102	AMD Radeon RX 6750 XT amd · high · 12GB	D	265	125	110	130	14	Estimated
103	NVIDIA GeForce RTX 3050 nvidia · entry · 8GB	D	263	78	80	200	17	Estimated
104	Apple MacBook Air (M4) apple · mid	D	262	49	110	170	45	Estimated
105	NVIDIA GeForce GTX 1660 Super nvidia · mid · 6GB	D	261	117	30	200	26	Estimated
106	Intel Arc Pro B60 24GB intel · workstation · 24GB	D	260	106	170	80	15	Estimated
107	ASUS ROG Strix Scar 18 (RTX 5090 Mobile) nvidia · enthusiast · 24GB	D	259	0	170	200	0	Estimated
108	Razer Blade 16 (2025, RTX 5090 Mobile) nvidia · enthusiast · 24GB	D	259	0	170	200	0	Estimated
109	NVIDIA GeForce RTX 2060 nvidia · mid · 6GB	D	257	117	30	200	20	Estimated
110	Intel Arc A770 16GB intel · mid · 16GB	D	256	130	140	80	16	Estimated
111	AMD Radeon RX 7600 XT amd · mid · 16GB	D	256	84	140	130	12	Estimated
112	AMD Radeon RX 6700 XT amd · high · 12GB	D	255	111	110	130	13	Estimated
113	NVIDIA GeForce GTX 1660 Ti nvidia · mid · 6GB	D	247	100	30	200	23	Estimated
114	AMD Ryzen AI 9 HX 370 (Strix Point) amd · pc-npu	D	246	26	170	130	26	Estimated
115	Apple Mac Mini (M4) apple · mid	D	245	49	110	170	21	Estimated
116	Apple M4 (iPad Pro) apple · mobile	D	244	49	30	170	100	Estimated
117	Lenovo Legion 5 Pro Gen 7 (RTX 3080 16GB) nvidia · high · 16GB	D	238	0	140	200	0	Estimated
118	Apple A18 Pro apple · mobile	D	227	24	30	170	100	Estimated
119	Apple A17 Pro apple · mobile	D	225	21	30	170	100	Estimated
120	NVIDIA GeForce RTX 3050 Ti (Mobile) nvidia · mobile · 4GB	D	224	67	30	200	23	Estimated
121	NVIDIA GeForce GTX 1650 Super nvidia · entry · 4GB	D	221	67	30	200	18	Estimated
122	Intel Arc B580 intel · mid · 12GB	D	218	106	110	80	15	Estimated
123	NVIDIA GeForce GTX 1660 nvidia · mid · 6GB	D	218	67	30	200	15	Estimated
124	NVIDIA GeForce GTX 1060 3GB nvidia · entry · 3GB	D	218	67	30	200	15	Estimated
125	NVIDIA GeForce GTX 1060 6GB nvidia · entry · 6GB	D	218	67	30	200	15	Estimated
126	ASUS Ascent GX10 (NVIDIA GB10) nvidia · workstation	D	217	95	0	200	15	Estimated
127	NVIDIA DGX Spark (Project Digits) nvidia · workstation	D	216	95	0	200	13	Estimated
128	AMD Radeon RX 5700 XT amd · high · 8GB	D	214	130	80	80	16	Estimated
129	AMD Radeon RX 6650 XT amd · mid · 8GB	D	212	81	80	130	12	Estimated
130	AMD Radeon RX 6600 XT amd · mid · 8GB	D	208	74	80	130	13	Estimated
131	NVIDIA GeForce GTX 1650 nvidia · entry · 4GB	D	204	45	30	200	16	Estimated
132	Qualcomm Snapdragon 8 Elite qualcomm · mobile	D	204	21	110	60	100	Estimated
133	AMD Radeon RX 6600 amd · mid · 8GB	D	202	65	80	130	14	Estimated
134	NVIDIA GeForce GTX 1050 Ti nvidia · entry · 4GB	D	198	39	30	200	14	Estimated
135	Intel Arc B570 intel · mid · 10GB	D	185	88	80	80	16	Estimated
136	Qualcomm Snapdragon 8 Gen 3 qualcomm · mobile	D	179	18	80	60	98	Estimated
137	Intel Core Ultra 7 258V (Lunar Lake) intel · pc-npu	D	177	32	110	60	51	Estimated
138	Intel Core Ultra 300 (Panther Lake) intel · pc-npu	D	175	0	170	80	0	Estimated
139	AMD Radeon RX 580 8GB amd · mid · 8GB	D	172	74	80	80	11	Estimated
140	AMD Radeon RX 5500 XT 8GB amd · entry · 8GB	D	167	65	80	80	14	Estimated
141	Google Tensor G4 google · mobile	D	162	14	80	60	77	Estimated
142	NVIDIA RTX Spark nvidia · workstation	D	161	0	0	200	30	Estimated
143	Qualcomm Snapdragon X2 Elite qualcomm · pc-npu	D	161	0	170	60	0	Estimated
144	AMD EPYC 9005 (Zen 5, Turin) amd · workstation	D	161	178	0	40	12	Estimated
145	AMD Radeon RX 5600 XT amd · mid · 6GB	D	158	97	30	80	18	Estimated
146	AMD Ryzen AI Halo amd · workstation	D	155	74	0	130	17	Estimated
147	HP ZBook Ultra G1a (Ryzen AI Max+ PRO 395) amd · workstation	D	155	74	0	130	17	Estimated
148	Framework Desktop (Ryzen AI Max+ 395) amd · workstation	D	153	74	0	130	15	Estimated
149	GMKtec EVO-X2 (Ryzen AI Max+ 395) amd · workstation	D	153	74	0	130	15	Estimated
150	Framework Laptop 16 (RX 7700S) amd · mid · 8GB	D	147	0	80	130	0	Estimated
151	AMD Radeon 880M (Strix Point iGPU) amd · entry	D	132	30	0	130	29	Estimated
152	AMD Radeon RX 570 amd · entry · 4GB	D	131	65	30	80	12	Estimated
153	AMD Radeon 780M (Phoenix iGPU) amd · entry	D	127	26	0	130	25	Estimated
154	Intel Arc 140V (Lunar Lake iGPU) intel · entry	D	115	32	0	80	52	Estimated
155	GMKtec EVO-X3 other · workstation	D	106	59	0	80	12	Estimated
156	Qualcomm Snapdragon X Elite qualcomm · high	D	28	0	0	40	0	Estimated
157	Qualcomm Snapdragon X Plus qualcomm · mid	D	28	0	0	40	0	Estimated

BLK · BUY · AMAZON

Shop GPUs & AI hardware on Amazon:GPU categoryRTX 4090RTX 5090Apple M-seriesAI mini-PCs

Amazon search links — we may earn a small commission at no extra cost to you. How we make money.

HOW THE SCORE IS DERIVED

Throughput · 0–500

Steady-state tok/s on a representative 7B/8B Q4 model. Measured from real benchmark rows, or extrapolated from VRAM bandwidth × runtime-stack efficiency.

VRAM-fit · 0–200

How comfortably the rig holds 7B / 32B / 70B class models. Apple unified memory counts; NPU/SoC system RAM counts.

Ecosystem · 0–200

CUDA / MLX / ROCm / Vulkan reach. Real-world friction the operator hits when installing tools.

Efficiency · 0–100

Tok/s per watt. Mobile / NPU class scores well; dense desktop GPUs trade efficiency for absolute throughput.

A confidence multiplier (1.0 measured · 0.85 extrapolated · 0.7 estimated) discounts the headline so we don't pretend to know more than we do. Score is recomputed on every page load against the latest catalog + benchmark data — submit your own run with runlocalai-bench --submit --hardware your-rig to firm up the numbers.

> RunLocalAI Score

RunLocalAI Score