Original benchmark dataset

Local LLM benchmarks

Tokens-per-second rows collected on owner hardware or from cited, reproduced sources. Every public row ships with a confidence badge so you know which numbers are owner-measured, independently reproduced, or source-backed.

Confidence engine
0 strong
Coverage map
0 wanted
Regression watch
version-aware
Reproduce
protocol + queue
Selected coverage slice

0 measured or reviewed / 0 estimated / 0 wanted / 168 unstarted

0.0% of 168 selected cells measured or reviewed

0 measured or reviewed cells, 0 estimated cells, 0 wanted cells, and 168 unstarted cells.

Selected benchmark coverage by hardware and model. Measured, reviewed, estimated, and wanted cells are visually distinct.
Hardware / Model
all-MiniLM-L6-v2
DeepSeek V4 Pro (1
FLUX.1 [dev]
Qwen 3 235B-A22B
Llama 4 Scout
DeepSeek V4 Flash
Llama 3.1 8B Instr
DeepSeek R1 (671B
Qwen 3 0.6B
Kokoro 82M
Nomic Embed Text v
BGE Large EN v1.5
Qwen 3 30B-A3B
Qwen 2.5 Coder 32B
NVIDIA GeForce RTX 3090 Ti
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 3090 Ti: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 3090 Ti: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 3090 Ti: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 3090 Ti: not started
Llama 4 Scout on NVIDIA GeForce RTX 3090 Ti: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 3090 Ti: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 3090 Ti: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 3090 Ti: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 3090 Ti: not started
Kokoro 82M on NVIDIA GeForce RTX 3090 Ti: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 3090 Ti: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 3090 Ti: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 3090 Ti: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 3090 Ti: not started
NVIDIA GeForce RTX 4060
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4060: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4060: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 4060: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 4060: not started
Llama 4 Scout on NVIDIA GeForce RTX 4060: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4060: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4060: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4060: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 4060: not started
Kokoro 82M on NVIDIA GeForce RTX 4060: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4060: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 4060: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 4060: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4060: not started
NVIDIA GeForce RTX 4070
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4070: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4070: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 4070: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 4070: not started
Llama 4 Scout on NVIDIA GeForce RTX 4070: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4070: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4070: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4070: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 4070: not started
Kokoro 82M on NVIDIA GeForce RTX 4070: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4070: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 4070: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 4070: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4070: not started
NVIDIA GeForce RTX 5090 Mobi
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5090 Mobile: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5090 Mobile: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 5090 Mobile: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 5090 Mobile: not started
Llama 4 Scout on NVIDIA GeForce RTX 5090 Mobile: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5090 Mobile: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5090 Mobile: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5090 Mobile: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 5090 Mobile: not started
Kokoro 82M on NVIDIA GeForce RTX 5090 Mobile: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5090 Mobile: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 5090 Mobile: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 5090 Mobile: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5090 Mobile: not started
NVIDIA RTX PRO 6000 Blackwel
all-MiniLM-L6-v2 on NVIDIA RTX PRO 6000 Blackwell: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA RTX PRO 6000 Blackwell: not started
FLUX.1 [dev] on NVIDIA RTX PRO 6000 Blackwell: not started
Qwen 3 235B-A22B on NVIDIA RTX PRO 6000 Blackwell: not started
Llama 4 Scout on NVIDIA RTX PRO 6000 Blackwell: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA RTX PRO 6000 Blackwell: not started
Llama 3.1 8B Instruct on NVIDIA RTX PRO 6000 Blackwell: not started
DeepSeek R1 (671B reasoning) on NVIDIA RTX PRO 6000 Blackwell: not started
Qwen 3 0.6B on NVIDIA RTX PRO 6000 Blackwell: not started
Kokoro 82M on NVIDIA RTX PRO 6000 Blackwell: not started
Nomic Embed Text v1.5 on NVIDIA RTX PRO 6000 Blackwell: not started
BGE Large EN v1.5 on NVIDIA RTX PRO 6000 Blackwell: not started
Qwen 3 30B-A3B on NVIDIA RTX PRO 6000 Blackwell: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA RTX PRO 6000 Blackwell: not started
NVIDIA GeForce RTX 5060 Ti 8
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5060 Ti 8GB: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5060 Ti 8GB: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Llama 4 Scout on NVIDIA GeForce RTX 5060 Ti 8GB: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5060 Ti 8GB: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Kokoro 82M on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5060 Ti 8GB: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 5060 Ti 8GB: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5060 Ti 8GB: not started
NVIDIA GeForce RTX 5060
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5060: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5060: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 5060: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 5060: not started
Llama 4 Scout on NVIDIA GeForce RTX 5060: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5060: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5060: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5060: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 5060: not started
Kokoro 82M on NVIDIA GeForce RTX 5060: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5060: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 5060: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 5060: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5060: not started
NVIDIA GeForce RTX 5070 Ti
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5070 Ti: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5070 Ti: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 5070 Ti: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 5070 Ti: not started
Llama 4 Scout on NVIDIA GeForce RTX 5070 Ti: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5070 Ti: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5070 Ti: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5070 Ti: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 5070 Ti: not started
Kokoro 82M on NVIDIA GeForce RTX 5070 Ti: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5070 Ti: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 5070 Ti: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 5070 Ti: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5070 Ti: not started
NVIDIA GeForce RTX 4090 Mobi
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4090 Mobile: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4090 Mobile: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 4090 Mobile: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 4090 Mobile: not started
Llama 4 Scout on NVIDIA GeForce RTX 4090 Mobile: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4090 Mobile: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4090 Mobile: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4090 Mobile: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 4090 Mobile: not started
Kokoro 82M on NVIDIA GeForce RTX 4090 Mobile: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4090 Mobile: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 4090 Mobile: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 4090 Mobile: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4090 Mobile: not started
NVIDIA GeForce RTX 4070 Ti
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4070 Ti: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4070 Ti: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 4070 Ti: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 4070 Ti: not started
Llama 4 Scout on NVIDIA GeForce RTX 4070 Ti: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4070 Ti: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4070 Ti: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4070 Ti: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 4070 Ti: not started
Kokoro 82M on NVIDIA GeForce RTX 4070 Ti: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4070 Ti: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 4070 Ti: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 4070 Ti: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4070 Ti: not started
NVIDIA GeForce RTX 4070 Ti S
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 4070 Ti Super: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 4070 Ti Super: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 4070 Ti Super: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 4070 Ti Super: not started
Llama 4 Scout on NVIDIA GeForce RTX 4070 Ti Super: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 4070 Ti Super: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 4070 Ti Super: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 4070 Ti Super: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 4070 Ti Super: not started
Kokoro 82M on NVIDIA GeForce RTX 4070 Ti Super: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 4070 Ti Super: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 4070 Ti Super: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 4070 Ti Super: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 4070 Ti Super: not started
NVIDIA GeForce RTX 5070
all-MiniLM-L6-v2 on NVIDIA GeForce RTX 5070: not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA GeForce RTX 5070: not started
FLUX.1 [dev] on NVIDIA GeForce RTX 5070: not started
Qwen 3 235B-A22B on NVIDIA GeForce RTX 5070: not started
Llama 4 Scout on NVIDIA GeForce RTX 5070: not started
DeepSeek V4 Flash (284B MoE) on NVIDIA GeForce RTX 5070: not started
Llama 3.1 8B Instruct on NVIDIA GeForce RTX 5070: not started
DeepSeek R1 (671B reasoning) on NVIDIA GeForce RTX 5070: not started
Qwen 3 0.6B on NVIDIA GeForce RTX 5070: not started
Kokoro 82M on NVIDIA GeForce RTX 5070: not started
Nomic Embed Text v1.5 on NVIDIA GeForce RTX 5070: not started
BGE Large EN v1.5 on NVIDIA GeForce RTX 5070: not started
Qwen 3 30B-A3B on NVIDIA GeForce RTX 5070: not started
Qwen 2.5 Coder 32B Instruct on NVIDIA GeForce RTX 5070: not started
RunLocalAI measuredReproducedVendor-publishedCommunity-reviewedLow/unverified measuredEstimatedCritical wantedWantedNot started

No benchmarks published yet.

Owner-run measurements will appear here as they're added through the admin form.