Will it run?
Identify your hardware. We compute which open-weight AI models you can run locally, how fast, with what tradeoffs.
> Backed by real benchmarks when available, computed from memory bandwidth + model architecture otherwise. Confidence tier always shown next to every number.
Pick a common build
MODULE 02 · CLUSTER TOPOLOGYMulti-GPU or cluster setup?
Dual GPUs, quad workstation, mixed cards, Apple unified, Exo cluster — total VRAM ≠ pooled VRAM, and we explain why.▼
Multi-GPU or cluster setup?
Build your own rig
Pick any GPUs (single/dual/mixed/multi-node), set CPU/RAM/OS, choose runtime + use case. We compute effective VRAM honestly, recommend a runtime, and tell you which models fit comfortably.
Your hardware
> all four fields required
Not enough VRAM for the model you want? Rent a GPU by the hour
If the probe says a model won't fit your card, you can rent a GPU with enough VRAM by the hour to run it now, or to test it before you buy hardware.
RunPod
billed per GPU-hourHourly GPU pods, in community-cloud and secure-cloud tiers.
The two tiers run on different hosts and terms. Check which tier a pod is on before a long job.
Rent on RunPodVast.ai
billed per GPU-hourMarketplace of host-listed GPUs; price and reliability vary by host.
Host quality varies. Filter for verified hosts and check the host's reliability before a long run.
Rent on Vast.aiReferral links: RunLocalAI may earn a commission or account credits if you sign up and rent, at no extra cost to you. Hourly rates and which GPUs are listed change all the time, so check the provider's page before you start. Editorial opinions are independent of the referral relationship; see how we make money.