Community submitted(Public roadmap)

Benchmark roadmap — what we want measured

The public version of our benchmark queue. Each entry is a model+hardware combo we'd like a measurement for, and why that measurement would unlock useful pages or sharpen a confidence tier. If you have the rig, click “I can measure this” — the submission form arrives prefilled with model, hardware, and runtime.

Pending
16
In progress
0
Measured
0
Critical
1
Selected coverage slice

0 measured or reviewed / 0 estimated / 0 wanted / 168 unstarted

0.0% of 168 selected cells measured or reviewed

0 measured or reviewed cells, 0 estimated cells, 0 wanted cells, and 168 unstarted cells.

Selected benchmark coverage by hardware and model. Measured, reviewed, estimated, and wanted cells are visually distinct.
Hardware / Model
all-MiniLM-L6-v2
FLUX.1 [dev]
DeepSeek V4 Pro (1
Qwen 3 235B-A22B
Nomic Embed Text v
Kokoro 82M
Llama 4 Scout
Llama 3.1 8B Instr
DeepSeek V4 Flash
DeepSeek R1 (671B
BGE Large EN v1.5
Qwen 3 0.6B
Qwen 3 30B-A3B
Llama 3.3 70B Inst
NVIDIA DGX Spark (Project Di
all-MiniLM-L6-v2 on NVIDIA DGX Spark (Project Digits): not started
FLUX.1 [dev] on NVIDIA DGX Spark (Project Digits): not started
DeepSeek V4 Pro (1.6T MoE) on NVIDIA DGX Spark (Project Digits): not started
Qwen 3 235B-A22B on NVIDIA DGX Spark (Project Digits): not started
Nomic Embed Text v1.5 on NVIDIA DGX Spark (Project Digits): not started
Kokoro 82M on NVIDIA DGX Spark (Project Digits): not started
Llama 4 Scout on NVIDIA DGX Spark (Project Digits): not started
Llama 3.1 8B Instruct on NVIDIA DGX Spark (Project Digits): not started
DeepSeek V4 Flash (284B MoE) on NVIDIA DGX Spark (Project Digits): not started
DeepSeek R1 (671B reasoning) on NVIDIA DGX Spark (Project Digits): not started
BGE Large EN v1.5 on NVIDIA DGX Spark (Project Digits): not started
Qwen 3 0.6B on NVIDIA DGX Spark (Project Digits): not started
Qwen 3 30B-A3B on NVIDIA DGX Spark (Project Digits): not started
Llama 3.3 70B Instruct on NVIDIA DGX Spark (Project Digits): not started
Apple M1 Ultra
all-MiniLM-L6-v2 on Apple M1 Ultra: not started
FLUX.1 [dev] on Apple M1 Ultra: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M1 Ultra: not started
Qwen 3 235B-A22B on Apple M1 Ultra: not started
Nomic Embed Text v1.5 on Apple M1 Ultra: not started
Kokoro 82M on Apple M1 Ultra: not started
Llama 4 Scout on Apple M1 Ultra: not started
Llama 3.1 8B Instruct on Apple M1 Ultra: not started
DeepSeek V4 Flash (284B MoE) on Apple M1 Ultra: not started
DeepSeek R1 (671B reasoning) on Apple M1 Ultra: not started
BGE Large EN v1.5 on Apple M1 Ultra: not started
Qwen 3 0.6B on Apple M1 Ultra: not started
Qwen 3 30B-A3B on Apple M1 Ultra: not started
Llama 3.3 70B Instruct on Apple M1 Ultra: not started
AMD Instinct MI300X
all-MiniLM-L6-v2 on AMD Instinct MI300X: not started
FLUX.1 [dev] on AMD Instinct MI300X: not started
DeepSeek V4 Pro (1.6T MoE) on AMD Instinct MI300X: not started
Qwen 3 235B-A22B on AMD Instinct MI300X: not started
Nomic Embed Text v1.5 on AMD Instinct MI300X: not started
Kokoro 82M on AMD Instinct MI300X: not started
Llama 4 Scout on AMD Instinct MI300X: not started
Llama 3.1 8B Instruct on AMD Instinct MI300X: not started
DeepSeek V4 Flash (284B MoE) on AMD Instinct MI300X: not started
DeepSeek R1 (671B reasoning) on AMD Instinct MI300X: not started
BGE Large EN v1.5 on AMD Instinct MI300X: not started
Qwen 3 0.6B on AMD Instinct MI300X: not started
Qwen 3 30B-A3B on AMD Instinct MI300X: not started
Llama 3.3 70B Instruct on AMD Instinct MI300X: not started
Apple M2 Ultra
all-MiniLM-L6-v2 on Apple M2 Ultra: not started
FLUX.1 [dev] on Apple M2 Ultra: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M2 Ultra: not started
Qwen 3 235B-A22B on Apple M2 Ultra: not started
Nomic Embed Text v1.5 on Apple M2 Ultra: not started
Kokoro 82M on Apple M2 Ultra: not started
Llama 4 Scout on Apple M2 Ultra: not started
Llama 3.1 8B Instruct on Apple M2 Ultra: not started
DeepSeek V4 Flash (284B MoE) on Apple M2 Ultra: not started
DeepSeek R1 (671B reasoning) on Apple M2 Ultra: not started
BGE Large EN v1.5 on Apple M2 Ultra: not started
Qwen 3 0.6B on Apple M2 Ultra: not started
Qwen 3 30B-A3B on Apple M2 Ultra: not started
Llama 3.3 70B Instruct on Apple M2 Ultra: not started
Apple A17 Pro
all-MiniLM-L6-v2 on Apple A17 Pro: not started
FLUX.1 [dev] on Apple A17 Pro: not started
DeepSeek V4 Pro (1.6T MoE) on Apple A17 Pro: not started
Qwen 3 235B-A22B on Apple A17 Pro: not started
Nomic Embed Text v1.5 on Apple A17 Pro: not started
Kokoro 82M on Apple A17 Pro: not started
Llama 4 Scout on Apple A17 Pro: not started
Llama 3.1 8B Instruct on Apple A17 Pro: not started
DeepSeek V4 Flash (284B MoE) on Apple A17 Pro: not started
DeepSeek R1 (671B reasoning) on Apple A17 Pro: not started
BGE Large EN v1.5 on Apple A17 Pro: not started
Qwen 3 0.6B on Apple A17 Pro: not started
Qwen 3 30B-A3B on Apple A17 Pro: not started
Llama 3.3 70B Instruct on Apple A17 Pro: not started
Apple A18 Pro
all-MiniLM-L6-v2 on Apple A18 Pro: not started
FLUX.1 [dev] on Apple A18 Pro: not started
DeepSeek V4 Pro (1.6T MoE) on Apple A18 Pro: not started
Qwen 3 235B-A22B on Apple A18 Pro: not started
Nomic Embed Text v1.5 on Apple A18 Pro: not started
Kokoro 82M on Apple A18 Pro: not started
Llama 4 Scout on Apple A18 Pro: not started
Llama 3.1 8B Instruct on Apple A18 Pro: not started
DeepSeek V4 Flash (284B MoE) on Apple A18 Pro: not started
DeepSeek R1 (671B reasoning) on Apple A18 Pro: not started
BGE Large EN v1.5 on Apple A18 Pro: not started
Qwen 3 0.6B on Apple A18 Pro: not started
Qwen 3 30B-A3B on Apple A18 Pro: not started
Llama 3.3 70B Instruct on Apple A18 Pro: not started
Apple M1 Max
all-MiniLM-L6-v2 on Apple M1 Max: not started
FLUX.1 [dev] on Apple M1 Max: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M1 Max: not started
Qwen 3 235B-A22B on Apple M1 Max: not started
Nomic Embed Text v1.5 on Apple M1 Max: not started
Kokoro 82M on Apple M1 Max: not started
Llama 4 Scout on Apple M1 Max: not started
Llama 3.1 8B Instruct on Apple M1 Max: not started
DeepSeek V4 Flash (284B MoE) on Apple M1 Max: not started
DeepSeek R1 (671B reasoning) on Apple M1 Max: not started
BGE Large EN v1.5 on Apple M1 Max: not started
Qwen 3 0.6B on Apple M1 Max: not started
Qwen 3 30B-A3B on Apple M1 Max: not started
Llama 3.3 70B Instruct on Apple M1 Max: not started
Apple M2 Max
all-MiniLM-L6-v2 on Apple M2 Max: not started
FLUX.1 [dev] on Apple M2 Max: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M2 Max: not started
Qwen 3 235B-A22B on Apple M2 Max: not started
Nomic Embed Text v1.5 on Apple M2 Max: not started
Kokoro 82M on Apple M2 Max: not started
Llama 4 Scout on Apple M2 Max: not started
Llama 3.1 8B Instruct on Apple M2 Max: not started
DeepSeek V4 Flash (284B MoE) on Apple M2 Max: not started
DeepSeek R1 (671B reasoning) on Apple M2 Max: not started
BGE Large EN v1.5 on Apple M2 Max: not started
Qwen 3 0.6B on Apple M2 Max: not started
Qwen 3 30B-A3B on Apple M2 Max: not started
Llama 3.3 70B Instruct on Apple M2 Max: not started
Apple M3 Ultra
all-MiniLM-L6-v2 on Apple M3 Ultra: not started
FLUX.1 [dev] on Apple M3 Ultra: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M3 Ultra: not started
Qwen 3 235B-A22B on Apple M3 Ultra: not started
Nomic Embed Text v1.5 on Apple M3 Ultra: not started
Kokoro 82M on Apple M3 Ultra: not started
Llama 4 Scout on Apple M3 Ultra: not started
Llama 3.1 8B Instruct on Apple M3 Ultra: not started
DeepSeek V4 Flash (284B MoE) on Apple M3 Ultra: not started
DeepSeek R1 (671B reasoning) on Apple M3 Ultra: not started
BGE Large EN v1.5 on Apple M3 Ultra: not started
Qwen 3 0.6B on Apple M3 Ultra: not started
Qwen 3 30B-A3B on Apple M3 Ultra: not started
Llama 3.3 70B Instruct on Apple M3 Ultra: not started
Apple M4 (iPad Pro)
all-MiniLM-L6-v2 on Apple M4 (iPad Pro): not started
FLUX.1 [dev] on Apple M4 (iPad Pro): not started
DeepSeek V4 Pro (1.6T MoE) on Apple M4 (iPad Pro): not started
Qwen 3 235B-A22B on Apple M4 (iPad Pro): not started
Nomic Embed Text v1.5 on Apple M4 (iPad Pro): not started
Kokoro 82M on Apple M4 (iPad Pro): not started
Llama 4 Scout on Apple M4 (iPad Pro): not started
Llama 3.1 8B Instruct on Apple M4 (iPad Pro): not started
DeepSeek V4 Flash (284B MoE) on Apple M4 (iPad Pro): not started
DeepSeek R1 (671B reasoning) on Apple M4 (iPad Pro): not started
BGE Large EN v1.5 on Apple M4 (iPad Pro): not started
Qwen 3 0.6B on Apple M4 (iPad Pro): not started
Qwen 3 30B-A3B on Apple M4 (iPad Pro): not started
Llama 3.3 70B Instruct on Apple M4 (iPad Pro): not started
Apple M4 Max
all-MiniLM-L6-v2 on Apple M4 Max: not started
FLUX.1 [dev] on Apple M4 Max: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M4 Max: not started
Qwen 3 235B-A22B on Apple M4 Max: not started
Nomic Embed Text v1.5 on Apple M4 Max: not started
Kokoro 82M on Apple M4 Max: not started
Llama 4 Scout on Apple M4 Max: not started
Llama 3.1 8B Instruct on Apple M4 Max: not started
DeepSeek V4 Flash (284B MoE) on Apple M4 Max: not started
DeepSeek R1 (671B reasoning) on Apple M4 Max: not started
BGE Large EN v1.5 on Apple M4 Max: not started
Qwen 3 0.6B on Apple M4 Max: not started
Qwen 3 30B-A3B on Apple M4 Max: not started
Llama 3.3 70B Instruct on Apple M4 Max: not started
Apple M4 Pro
all-MiniLM-L6-v2 on Apple M4 Pro: not started
FLUX.1 [dev] on Apple M4 Pro: not started
DeepSeek V4 Pro (1.6T MoE) on Apple M4 Pro: not started
Qwen 3 235B-A22B on Apple M4 Pro: not started
Nomic Embed Text v1.5 on Apple M4 Pro: not started
Kokoro 82M on Apple M4 Pro: not started
Llama 4 Scout on Apple M4 Pro: not started
Llama 3.1 8B Instruct on Apple M4 Pro: not started
DeepSeek V4 Flash (284B MoE) on Apple M4 Pro: not started
DeepSeek R1 (671B reasoning) on Apple M4 Pro: not started
BGE Large EN v1.5 on Apple M4 Pro: not started
Qwen 3 0.6B on Apple M4 Pro: not started
Qwen 3 30B-A3B on Apple M4 Pro: not started
Llama 3.3 70B Instruct on Apple M4 Pro: not started
RunLocalAI measuredReproducedVendor-publishedCommunity-reviewedLow/unverified measuredEstimatedCritical wantedWantedNot started

Have a rig? Capture a useful benchmark in 10-20 minutes.

The public benchmark runner captures the variables we currently use for review: runtime, GPU, OS, driver, run spread, and a paste-ready result block. Nothing uploads unless you pass --submit.

Windows
iwr -useb https://www.runlocalai.co/bench.mjs -OutFile bench.mjs; node bench.mjs --model llama3.1:8b
macOS / Linux / WSL
curl -fsSL https://www.runlocalai.co/bench.mjs -o bench.mjs && node bench.mjs --model llama3.1:8b

How this works

1. We mark a model+hardware combo as “wanted” when measuring it would unlock new pages, sharpen a confidence tier, or fill a gap that operators are repeatedly asking about.

2. When you click “I can measure this,” the submission form opens with the model, hardware, and runtime prefilled. You add your measurements (tok/s, VRAM, context, runtime version, OS).

3. Submissions still go through editorial review. We don't auto-publish. If your numbers are plausible and well-documented, we mark the opportunity as measured and the benchmark goes live with full attribution.

  • Critical
    target: 55-75 tok/s decode (single stream)

    Single RTX 5090 + Qwen 3 Coder 32B (vLLM, AWQ-INT4)

    Qwen 3 Coder 32B on NVIDIA GeForce RTX 5090 · vLLM · AWQ-INT4

    Why we want this

    The single-5090 baseline is the comparison anchor for every multi-GPU recommendation on this site. Without it, the 'should I just buy one bigger card?' question can't be answered with confidence.

    Unlocks
    /hardware/rtx-5090/guides/choosing-a-gpu-for-local-ai-2026/guides/running-local-ai-on-multiple-gpus-2026/will-it-run/rtx-5090
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 12-25 tok/s decode (Hexagon NPU, estimate)

    Snapdragon 8 Elite + Phi-3.5 Mini (Qualcomm AI Hub, INT8)

    Phi-3.5 Mini Instruct on Qualcomm Snapdragon 8 Elite · Qualcomm AI Hub · INT8

    Why we want this

    Snapdragon 8 Elite is the mid-2025 flagship for Android on-device LLM inference. Establishing the NPU-vs-GPU-fallback tradeoff numbers is critical for the Android-on-device guidance.

    Unlocks
    /hardware/snapdragon-8-elite/tools/qualcomm-ai-hub/stacks/android-on-device-ai
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 8-15 tok/s decode (estimate, sustained)

    iPhone 16 Pro + Llama 3.2 3B (MLX Swift, INT4)

    Llama 3.2 3B Instruct on Apple A18 Pro · MLX Swift · MLX-INT4

    Why we want this

    Mobile on-device LLM viability is the most-asked question in the iPhone-developer ecosystem in 2026. A measured tok/s + battery drain + thermal throttling curve answers 'can I ship this in my app?'

    Unlocks
    /hardware/apple-a18-pro/systems/mobile-local-ai/stacks/iphone-on-device-ai
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 100-160 tok/s decode (single stream)

    4× H100 SXM + DeepSeek V4 Flash (vLLM TP-4, INT4)

    DeepSeek V4 Flash (284B MoE) on · vLLM · AWQ-INT4

    Why we want this

    DeepSeek V4 Flash with the MTP head is claimed to be the throughput leader. Verifying the MTP advantage on production hardware is high-value for V4-Pro-vs-V4-Flash decision-making.

    Unlocks
    /hardware-combos/vllm-tensor-parallel-h100-workstation/stacks/h100-tensor-parallel-workstation/models/deepseek-v4-flash
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 8-14 tok/s decode (single stream)

    Mac Studio M3 Ultra 192GB + Qwen 3.5 235B-A17B (MLX-4bit)

    Qwen 3.5 235B-A17B (MoE) on · MLX-LM · MLX-4bit

    Why we want this

    The Apple-vs-NVIDIA comparison at the frontier-MoE tier is the most-asked question for Mac Studio buyers. Editorial estimate is 25-30% of NVIDIA throughput; measured value would close the loop.

    Unlocks
    /hardware-combos/mac-studio-m3-ultra-192gb/stacks/apple-silicon-ai/will-it-run/combo/mac-studio-m3-ultra-192gb/guides/running-local-ai-on-multiple-gpus-2026
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 60-90 tok/s decode (single stream)

    4× H100 SXM + Qwen 3.5 235B-A17B (vLLM TP-4, FP8)

    Qwen 3.5 235B-A17B (MoE) on · vLLM · FP8

    Why we want this

    The frontier-MoE production reference. Organizations weighing $200k+ DGX-class purchases vs cloud rental need measured throughput to model cost-per-million-tokens accurately.

    Unlocks
    /hardware-combos/vllm-tensor-parallel-h100-workstation/stacks/h100-tensor-parallel-workstation/will-it-run/combo/vllm-tensor-parallel-h100-workstation/guides/running-local-ai-on-multiple-gpus-2026
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 28-36 tok/s decode (PCIe only)

    Dual RTX 4090 + Llama 3.3 70B Q4 (vLLM tensor-parallel)

    Llama 3.3 70B Instruct on · vLLM · AWQ-INT4

    Why we want this

    Pairs with the dual-3090 measurement to quantify the NVLink-vs-PCIe penalty. The 4090 NVLink absence is the single most-misunderstood spec gap; a measured comparison ends the speculation.

    Unlocks
    /hardware-combos/dual-rtx-4090/stacks/dual-4090-workstation/will-it-run/combo/dual-rtx-4090/guides/running-local-ai-on-multiple-gpus-2026
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • High
    target: 25-32 tok/s decode (NVLink)

    Dual RTX 3090 + Llama 3.3 70B Q4 (vLLM tensor-parallel)

    Llama 3.3 70B Instruct on · vLLM · AWQ-INT4

    Why we want this

    The dual-3090 NVLink build is the most-recommended prosumer multi-GPU configuration on this site. Without a measured benchmark, the 25-32 tok/s estimate carries editorial-only confidence — operators making $1,500+ buying decisions deserve real numbers.

    Unlocks
    /hardware-combos/dual-rtx-3090/stacks/dual-3090-workstation/will-it-run/combo/dual-rtx-3090/guides/running-local-ai-on-multiple-gpus-2026
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 10-22 tok/s decode (Adreno GPU path)

    Snapdragon 8 Elite + Llama 3.2 3B (MLC LLM, GPU)

    Llama 3.2 3B Instruct on Qualcomm Snapdragon 8 Elite · MLC LLM · Q4_K_M (TVM-quant)

    Why we want this

    MLC LLM is cross-platform and the most-deployed mobile LLM runtime. The Adreno-vs-Hexagon comparison on the same SoC determines whether NPU lock-in is worth the throughput gain.

    Unlocks
    /hardware/snapdragon-8-elite/tools/mlc-llm/stacks/android-on-device-ai
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 20-35 tok/s decode (cold); throttle curve TBD

    iPad M4 + Qwen 2.5 3B (MLX, sustained-load curve)

    Qwen 2.5 3B Instruct on Apple M4 (iPad Pro) · MLX-LM · MLX-4bit

    Why we want this

    Tablet-class on-device viability for journaling / long-form summarization. Needs the throttle curve, not just peak tok/s.

    Unlocks
    /hardware/apple-m4-ipad/systems/mobile-local-ai
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 18-35 tok/s decode (estimate)

    Intel Lunar Lake + Phi-3.5 Mini (OpenVINO NPU)

    Phi-3.5 Mini Instruct on Intel Core Ultra 7 258V (Lunar Lake) · ONNX Runtime Mobile · INT8

    Why we want this

    Lunar Lake is the Intel reference for Copilot+ PCs. Comparison vs Snapdragon X NPU determines which Copilot+ chip operators should prefer for on-device LLMs.

    Unlocks
    /hardware/intel-lunar-lake-258v/systems/mobile-local-ai
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 20-40 tok/s decode (estimate)

    Snapdragon X Elite + Phi-3.5 Mini (ONNX Runtime + DirectML NPU)

    Phi-3.5 Mini Instruct on Qualcomm Snapdragon X Elite · ONNX Runtime Mobile · INT8

    Why we want this

    Copilot+ PC ecosystem is rapidly expanding. The Snapdragon X NPU vs Lunar Lake NPU vs CPU-fallback comparison is the operator decision for Windows on-device deployments.

    Unlocks
    /hardware/snapdragon-x-elite/tools/onnx-runtime-mobile/systems/mobile-local-ai
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 30-45 tok/s per stream × 4-32 concurrent

    Ray Serve 4-node × 2× 4090 + Qwen 3 32B (concurrency scan)

    Qwen 3 32B on · Ray Serve · AWQ-INT4

    Why we want this

    Distributed-serving patterns differ from tensor-parallel — replicas scale aggregate concurrency, not single-stream model size. The concurrency scan reveals where Ray Serve replicas plateau.

    Unlocks
    /hardware-combos/ray-serve-distributed-multi-node/stacks/distributed-inference-homelab
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 4-9 tok/s decode (Thunderbolt 5 inter-node)

    4× Mac Mini M4 Pro Exo cluster + Llama 3.1 70B (MLX-4bit)

    Llama 3.1 70B Instruct on · Exo · MLX-4bit

    Why we want this

    Multi-Mac Exo clusters are an emerging pattern. The cluster-vs-single-Mac-Studio comparison establishes whether the cluster is ever the right answer outside extreme memory targets.

    Unlocks
    /hardware-combos/quad-mac-mini-m4-pro-exo/stacks/multi-machine-apple-cluster/will-it-run/combo/quad-mac-mini-m4-pro-exo
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Medium
    target: 20-28 tok/s decode (with thinking-mode bloat)

    4× RTX 3090 + DeepSeek R1 Distill Llama 70B (vLLM TP-4)

    DeepSeek R1 Distill Llama 70B on · vLLM · AWQ-INT4

    Why we want this

    Quad-3090 is the prosumer-ceiling stack. R1 reasoning workloads are a high-traffic use case but the thinking-mode token bloat changes the throughput calculation — needed to set realistic operator expectations.

    Unlocks
    /hardware-combos/quad-rtx-3090/stacks/quad-3090-workstation/will-it-run/combo/quad-rtx-3090
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.
  • Low
    target: 10-16 tok/s (asymmetric layer-split)

    llama.cpp layer-split + Mixtral 8x22B (mixed 4090+3090)

    Mixtral 8x22B Instruct on · llama.cpp · Q4_K_M

    Why we want this

    Research-tier benchmark — mixed-GPU is editorial-discouraged for new builds. Useful for users who already own asymmetric pairs.

    Unlocks
    /hardware-combos/mixed-4090-3090/stacks/mixed-4090-3090-workstation
    Use the benchmark script, then select this request in the submit form. We avoid guessed model commands unless a request stores a verified reproduction command.

Need a measurement we don't cover?

Got a measurement? Submit it directly — editorial adds the corresponding opportunity row and credits the gap to you.

Need one measured? Request it. Editorial reviews and surfaces accepted requests in the section above.