Stack Builder

Eight inputs — use case, budget, scale, privacy posture — and we compose the full rig: GPU + runtime + 1-3 model picks + first-run workflow + cost rollup + ready-to-paste install script. Three tiers side-by-side so the upgrade path stays visible.

Every recommendation references rule-based scoring; measured tok/s carries a confidence chip when surfaced. We don't invent numbers — when the data isn't there we say so.

Tell us about your build

URL updates as you change fields — share or bookmark a result. Showing the balanced default — change any field to refine.

Price figures are our planning estimates (launch MSRP, or a used-market estimate for older cards), not live prices. Check the current price before you buy.

Side-by-side: budget vs balanced vs stretch

one step down · your inputs · one step up
Budget
est. $350

One step down on budget. What you give up; what you keep.

Runtime
Top model
Qwen 3 14B· Q4_K_M
3-yr TCO
—
Check price on Amazon
Balanced
est. $899

Your inputs, our recommendation. Read the full card below.

Runtime
Top model
Qwen 3 14B· Q4_K_M
3-yr TCO
$1,046
Break-even
188 mo vs cloud
Search used listings on Amazon
Stretch
est. $899

One step up on budget. What you'd gain; what it costs.

Runtime
Top model
Qwen 3 14B· Q4_K_M
3-yr TCO
$1,046
Break-even
188 mo vs cloud
Search used listings on Amazon

Price figures are our planning estimates (launch MSRP, or a used-market estimate for older cards), not live prices. Check the current price before you buy. “Check price” links are affiliate links: we may earn a commission at no extra cost to you. How we make money.

Your recommended stack

full breakdown — read top to bottom
Balanced — recommended
nvidia24 GB VRAMest. $899

NVIDIA GeForce RTX 3090 + Ollama + Qwen 3 14B

§ Hardware
32B Q4 — estimated starting point; check artifact size and context
Expected throughput: No matched measurement is used for this recommendation. Check the evidence below for the tested model, quantization and runtime.
Estimated(rule-based scoring)Full hardware page →
Next step for NVIDIA GeForce RTX 3090
Search used listings on AmazonCheck the condition, the seller and the return policy.

Not sure this card is enough for the stack? Rent the same GPU for an evening and run the model and runtime above first.

Price figures are our planning estimates (launch MSRP, or a used-market estimate for older cards), not live prices. Check the current price before you buy.

Affiliate and referral links: we may earn a commission at no extra cost to you. Prices and stock change, so check the listing. How we make money.

§ Runtime

Default pick for most operators: one binary, automatic GPU detection, OpenAI-compatible HTTP API at `:11434`. Sufficient for solo + small-team workloads.

  • ›Install: curl -fsSL https://ollama.com/install.sh | sh
  • ›Pull a model: ollama pull <model>:<tag>
  • ›HTTP API at http://localhost:11434
§ Model picks (2)
  • Qwen 3 14B
    14B params
    Q4_K_M
    ~8.6 GB

    Strongest general-purpose model at 14B in 2026. Multilingual tokenizer (1.7× more efficient on Turkish/Asian languages than Llama). Reasoning mode available.

    C
    Community-reported·30-45 tok/s on 16GB VRAM
  • Phi-4 14B
    14B params
    Q4_K_M
    ~8.5 GB

    Microsoft's reasoning-focused 14B trained on heavy synthetic data. Beats Llama 3.1 8B on math/code benchmarks. Weaker creative writing.

    Ed
    Editorial·30-45 tok/s on 16GB VRAM
§ First-run workflow
✓ Curated stack match
Your inputs match the editorial stack Build a local coding-agent stack (May 2026). That page has the field-tested version of this recipe with concrete commands and a why-not-the-alternative for each pick.
  1. Install Ollama on Linux.
  2. Pull the primary model: ollama pull qwen3:14b
  3. Verify it runs: ollama run qwen3:14b — type a test prompt.
  4. Connect a coding agent: install Cline (VS Code extension) or Aider (CLI) and point it at http://localhost:11434 (Ollama) or :8000 (vLLM).
  5. Verify the full loop end-to-end before adding observability, monitoring, or any second model.
§ Total cost of ownership (3-year)
Upfront (est.)
$899
hardware, our price estimate
Monthly electricity
$4
at 0.84 kWh/day
3-year total
$1,046
upfront + electricity
Cloud equivalent
$319
same token volume
Break-even
188 mo
local beats cloud
Tok/s assumed
112.3
extrapolated
Assumptions: 4 hr/day active, 60% utilization, 3-year amortization, $0.30/M token cloud equivalent. Tune in cost calculator →
Rent instead
Try the stack before you buy the hardware

Rent a GPU of the same class by the hour and run the runtime and model picks above on it first. If the model does not fit or feels slow there, it will not on the card you buy.

Referral links: RunLocalAI may earn a commission or account credits if you sign up and rent, at no extra cost to you. Hourly rates and which GPUs are listed change all the time, so check the provider's page before you start. How we make money.

Install script

copy and paste — this gets you to first token
#!/usr/bin/env bash
# RunLocalAI stack installer — generated by /stack-builder
# Use case: coding
# Hardware: NVIDIA GeForce RTX 3090
# Runtime: Ollama

set -e

# 1. Install Ollama
curl -fsSL https://ollama.com/install.sh | sh

# 2. Pull the primary model
ollama pull qwen3:14b

# 3. Sanity check
ollama run qwen3:14b "Hello — respond in one short sentence to confirm you're running."

# 4. Verify the HTTP API
curl http://localhost:11434/api/tags