Custom build engine
Describe your build — any GPUs, CPU, RAM, OS, runtime, use case. We'll compute effective VRAM honestly, recommend a runtime, and tell you which models fit comfortably, which are borderline, and which aren't practical.
Total VRAM ≠ pooled VRAM. We never sum VRAM unless the silicon truly pools (Apple unified memory). We always explain why effective is lower than total.
Calculations follow the RunLocalAI Will-It-Run Framework: effective VRAM, model working set, runtime constraints, fit tiers, and measured-vs-estimated evidence labels.
Describe your build
Add GPUs, set CPU/RAM/OS, optionally pick a runtime + use case. URL updates as you change fields — share a build by copying the URL.
Build summary
Apple Silicon unified memory IS genuinely pooled — 0 GB shared between CPU and GPU. macOS reserves ~8 GB for the OS and apps, leaving ~0 GB for inference. Unlike NVIDIA multi-GPU, you don't pay an interconnect penalty here. The trade is bandwidth: ~400-800 GB/s vs an RTX 4090's 1 TB/s.
Measured evidence on this hardware
Publicly inspectable measured rows for the selected hardware slug(s). Exact measured rows calibrate the fit table instead of leaving it as pure VRAM estimation.
No publicly inspectable benchmark rows are attached to this exact hardware yet. The engine will still calculate fit and runtime, but speed rows will remain estimated.
Recommended runtime
Best engine for this topology + skill level + use case.
Models that fit your build
177 models considered. Categorized by headroom at the recommended quant + a sensible context for your use case.
No model fits comfortably on this build.
No borderline models — clean fit ladder.
| Model | Params | Quant | VRAM est. | Context | Evidence | Note |
|---|---|---|---|---|---|---|
| SmolLM2 135M Instruct | 0B | Q4_K_M | 0.2 GB | 8,192 | No measured row yet | ~0.2 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Gemma 3 270M | 0B | Q4_K_M | 0.4 GB | 8,192 | No measured row yet | ~0.4 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| SmolLM 2 360M Instruct | 0B | Q4_K_M | 0.5 GB | 8,192 | No measured row yet | ~0.5 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| SmolLM2 360M Instruct | 0B | Q4_K_M | 0.5 GB | 8,192 | No measured row yet | ~0.5 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| VBART Large (Turkish Summarization) | 0B | F32 | 1.7 GB | 1,024 | No measured row yet | ~1.7 GB needed at F32 + 1,024 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Qwen 2.5 0.5B Instruct | 1B | Q4_K_M | 0.7 GB | 8,192 | No measured row yet | ~0.7 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| GOT-OCR 2.0 | 1B | Q4_K_M | 0.3 GB | 0 | No measured row yet | ~0.3 GB needed at Q4_K_M + 0 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Qwen 3 0.6B | 1B | Q4_K_M | 0.7 GB | 8,192 | No measured row yet | ~0.7 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Kanarya 750M | 1B | BF16 | 1.7 GB | 2,048 | No measured row yet | ~1.7 GB needed at BF16 + 2,048 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Turkish GPT-2 Large | 1B | Q4_K_M | 0.6 GB | 1,024 | No measured row yet | ~0.6 GB needed at Q4_K_M + 1,024 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Florence-2 Large | 1B | FP16 | 1.8 GB | 4,096 | No measured row yet | ~1.8 GB needed at FP16 + 4,096 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| SigLIP SO400M (patch14-384) | 1B | F32 | 3.7 GB | 64 | No measured row yet | ~3.7 GB needed at F32 + 64 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Gemma 3 1B | 1B | Q4_K_M | 1.2 GB | 8,192 | No measured row yet | ~1.2 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| TinyLlama 1.1B Chat v1.0 | 1B | Q4_K_M | 0.8 GB | 2,048 | No measured row yet | ~0.8 GB needed at Q4_K_M + 2,048 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| Llama 3.2 1B Instruct | 1B | Q4_K_M | 1.5 GB | 8,192 | No measured row yet | ~1.5 GB needed at Q4_K_M + 8,192 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
| OLMo 2 1B Instruct | 1B | Q4_K_M | 1.4 GB | 4,096 | No measured row yet | ~1.4 GB needed at Q4_K_M + 4,096 ctx — overshoots effective VRAM by Infinity%. Drop quant or move to a larger build. |
This build can't hold SmolLM2 135M Instruct. By our estimate, a rented GPU with at least 1 GB runs it now, without buying new hardware.
Referral links: RunLocalAI may earn a commission or account credits if you sign up and rent, at no extra cost to you. Hourly rates and which GPUs are listed change all the time, so check the provider's page before you start. How we make money.
Related
NVLink vs PCIe, tensor- vs pipeline-parallel, mixed-card honesty.
Curated multi-GPU / cluster setups with effective-VRAM math.
OS + runtime install commands for your stack.
Runtime × OS × hardware support truth table.
Shopping a full build instead of a single card?
If you're sizing a fresh AI build (not just a card to drop into an existing system), the build-budget walkthroughs cover the whole BOM honestly: AI PC build under $1,000 or AI PC build under $2,000 cover the realistic 2026 budget tiers.
Vertical-fit shopping? AI PC for students covers the budget + portability tradeoffs; AI PC for developers covers the coding workflow specifics; AI PC for small business covers the document-RAG / always-on machine.
Form-factor first? See best laptop for local AI, best Mac for local AI, best mini PC for local AI, or best used GPU for local AI.