Original benchmark dataset
Local LLM benchmarks
Tokens-per-second rows collected on owner hardware or from cited, reproduced sources. Every public row ships with a confidence badge so you know which numbers are owner-measured, independently reproduced, or source-backed.
Confidence engine
0 strong
Coverage map
0 wanted
Regression watch
version-aware
Reproduce
protocol + queue
Selected coverage slice
0 measured or reviewed / 0 estimated / 0 wanted / 168 unstarted
0.0% of 168 selected cells measured or reviewed
0 measured or reviewed cells, 0 estimated cells, 0 wanted cells, and 168 unstarted cells.
| Hardware / Model | all-MiniLM-L6-v2 | DeepSeek V4 Pro (1 | FLUX.1 [dev] | Qwen 3 235B-A22B | Llama 4 Scout | DeepSeek V4 Flash | Llama 3.1 8B Instr | DeepSeek R1 (671B | Qwen 3 0.6B | Kokoro 82M | Nomic Embed Text v | BGE Large EN v1.5 | Qwen 3 30B-A3B | Qwen 2.5 Coder 32B |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NVIDIA GeForce RTX 3090 Ti | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 3090 Ti: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 3090 Ti: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 3090 Ti: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 3090 Ti: not started | Llama 4 Scout on NVIDIA GeForce RTX 3090 Ti: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 3090 Ti: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 3090 Ti: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 3090 Ti: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 3090 Ti: not started | Kokoro 82M on NVIDIA GeForce RTX 3090 Ti: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 3090 Ti: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 3090 Ti: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 3090 Ti: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 3090 Ti: not started |
| NVIDIA GeForce RTX 4060 | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4060: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4060: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 4060: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 4060: not started | Llama 4 Scout on NVIDIA GeForce RTX 4060: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4060: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4060: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4060: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 4060: not started | Kokoro 82M on NVIDIA GeForce RTX 4060: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4060: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 4060: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 4060: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4060: not started |
| NVIDIA GeForce RTX 4070 | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4070: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4070: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 4070: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 4070: not started | Llama 4 Scout on NVIDIA GeForce RTX 4070: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4070: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4070: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4070: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 4070: not started | Kokoro 82M on NVIDIA GeForce RTX 4070: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4070: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 4070: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 4070: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4070: not started |
| NVIDIA GeForce RTX 5090 Mobi | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5090 Mobile: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5090 Mobile: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 5090 Mobile: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 5090 Mobile: not started | Llama 4 Scout on NVIDIA GeForce RTX 5090 Mobile: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5090 Mobile: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5090 Mobile: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5090 Mobile: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 5090 Mobile: not started | Kokoro 82M on NVIDIA GeForce RTX 5090 Mobile: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5090 Mobile: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 5090 Mobile: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 5090 Mobile: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5090 Mobile: not started |
| NVIDIA RTX PRO 6000 Blackwel | all-MiniLM-L6-v2 on NVIDIA RTX PRO 6000 Blackwell: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA RTX PRO 6000 Blackwell: not started | FLUX.1 [dev] on NVIDIA RTX PRO 6000 Blackwell: not started | Qwen 3 235B-A22B on NVIDIA RTX PRO 6000 Blackwell: not started | Llama 4 Scout on NVIDIA RTX PRO 6000 Blackwell: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA RTX PRO 6000 Blackwell: not started | Llama 3.1 8B Instruct on NVIDIA RTX PRO 6000 Blackwell: not started | DeepSeek R1 (671B reasoning) on NVIDIA RTX PRO 6000 Blackwell: not started | Qwen 3 0.6B on NVIDIA RTX PRO 6000 Blackwell: not started | Kokoro 82M on NVIDIA RTX PRO 6000 Blackwell: not started | Nomic Embed Text v1.5 on NVIDIA RTX PRO 6000 Blackwell: not started | BGE Large EN v1.5 on NVIDIA RTX PRO 6000 Blackwell: not started | Qwen 3 30B-A3B on NVIDIA RTX PRO 6000 Blackwell: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA RTX PRO 6000 Blackwell: not started |
| NVIDIA GeForce RTX 5060 Ti 8 | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5060 Ti 8GB: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5060 Ti 8GB: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Llama 4 Scout on NVIDIA GeForce RTX 5060 Ti 8GB: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5060 Ti 8GB: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Kokoro 82M on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5060 Ti 8GB: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 5060 Ti 8GB: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5060 Ti 8GB: not started |
| NVIDIA GeForce RTX 5060 | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5060: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5060: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 5060: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 5060: not started | Llama 4 Scout on NVIDIA GeForce RTX 5060: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5060: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5060: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5060: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 5060: not started | Kokoro 82M on NVIDIA GeForce RTX 5060: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5060: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 5060: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 5060: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5060: not started |
| NVIDIA GeForce RTX 5070 Ti | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5070 Ti: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5070 Ti: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 5070 Ti: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 5070 Ti: not started | Llama 4 Scout on NVIDIA GeForce RTX 5070 Ti: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5070 Ti: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5070 Ti: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5070 Ti: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 5070 Ti: not started | Kokoro 82M on NVIDIA GeForce RTX 5070 Ti: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5070 Ti: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 5070 Ti: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 5070 Ti: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5070 Ti: not started |
| NVIDIA GeForce RTX 4090 Mobi | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4090 Mobile: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4090 Mobile: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 4090 Mobile: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 4090 Mobile: not started | Llama 4 Scout on NVIDIA GeForce RTX 4090 Mobile: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4090 Mobile: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4090 Mobile: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4090 Mobile: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 4090 Mobile: not started | Kokoro 82M on NVIDIA GeForce RTX 4090 Mobile: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4090 Mobile: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 4090 Mobile: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 4090 Mobile: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4090 Mobile: not started |
| NVIDIA GeForce RTX 4070 Ti | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4070 Ti: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4070 Ti: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 4070 Ti: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 4070 Ti: not started | Llama 4 Scout on NVIDIA GeForce RTX 4070 Ti: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4070 Ti: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4070 Ti: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4070 Ti: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 4070 Ti: not started | Kokoro 82M on NVIDIA GeForce RTX 4070 Ti: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4070 Ti: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 4070 Ti: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 4070 Ti: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4070 Ti: not started |
| NVIDIA GeForce RTX 4070 Ti S | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4070 Ti Super: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4070 Ti Super: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 4070 Ti Super: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 4070 Ti Super: not started | Llama 4 Scout on NVIDIA GeForce RTX 4070 Ti Super: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4070 Ti Super: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4070 Ti Super: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4070 Ti Super: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 4070 Ti Super: not started | Kokoro 82M on NVIDIA GeForce RTX 4070 Ti Super: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4070 Ti Super: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 4070 Ti Super: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 4070 Ti Super: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4070 Ti Super: not started |
| NVIDIA GeForce RTX 5070 | all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5070: not started | DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5070: not started | FLUX.1 [dev] on NVIDIA GeForce RTX 5070: not started | Qwen 3 235B-A22B on NVIDIA GeForce RTX 5070: not started | Llama 4 Scout on NVIDIA GeForce RTX 5070: not started | DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5070: not started | Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5070: not started | DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5070: not started | Qwen 3 0.6B on NVIDIA GeForce RTX 5070: not started | Kokoro 82M on NVIDIA GeForce RTX 5070: not started | Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5070: not started | BGE Large EN v1.5 on NVIDIA GeForce RTX 5070: not started | Qwen 3 30B-A3B on NVIDIA GeForce RTX 5070: not started | Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5070: not started |
RunLocalAI measuredReproducedVendor-publishedCommunity-reviewedLow/unverified measuredEstimatedCritical wantedWantedNot started
No benchmarks published yet.
Owner-run measurements will appear here as they're added through the admin form.