Out of memory

Ollama: model requires more system memory than is available

Q: How do you fix "Ollama: model requires more system memory than is available"?

**Check current system RAM usage:** ```bash # macOS / Linux free -h # Windows PowerShell Get-Counter '\Memory\Available MBytes' ``` **Free system RAM** by closing other apps (browsers, IDEs, Slack — these can chew 4-8 GB easily). **Use a smaller quantization** so the file is smaller on disk and in RAM: ```bash # Q4 instead of Q8 — half the file size ollama pull llama3.1:8b-instruct-q4_K_M ``` **Add swap (Linux):** ```bash sudo fallocate -l 16G /swapfile sudo chmod 600 /swapfile sudo mkswap /swapfile sudo swapon /swapfile ``` Loading is slower but possible. **Get more RAM.** For local AI work, 32 GB RAM is the practical floor; 64 GB or 128 GB unlocks larger models with CPU offload.

Error: model requires more system memory than is available

By Eruo Fredoline · Last verified Oct 7, 2026

Cause

Different from VRAM OOM — this is system RAM. Ollama needs to load the model file into RAM before transferring to VRAM (mmap'd or copied). On systems with low RAM and large models, the load step fails before the GPU is even involved.

Solution

Check current system RAM usage:

# macOS / Linux
free -h
# Windows PowerShell
Get-Counter '\Memory\Available MBytes'

Free system RAM by closing other apps (browsers, IDEs, Slack — these can chew 4-8 GB easily).

Use a smaller quantization so the file is smaller on disk and in RAM:

# Q4 instead of Q8 — half the file size
ollama pull llama3.1:8b-instruct-q4_K_M

Add swap (Linux):

sudo fallocate -l 16G /swapfile
sudo chmod 600 /swapfile
sudo mkswap /swapfile
sudo swapon /swapfile

Loading is slower but possible.

Get more RAM. For local AI work, 32 GB RAM is the practical floor; 64 GB or 128 GB unlocks larger models with CPU offload.

Cloud GPU rental

Not enough VRAM for this model? Rent a GPU by the hour

If Ollama falls back to the CPU because the model does not fit in your VRAM, you can rent a GPU that holds the whole model by the hour while you decide whether to upgrade.

RunPod

billed per GPU-hour

Hourly GPU pods, in community-cloud and secure-cloud tiers.

The two tiers run on different hosts and terms. Check which tier a pod is on before a long job.

Rent on RunPod

Vast.ai

billed per GPU-hour

Marketplace of host-listed GPUs; price and reliability vary by host.

Host quality varies. Filter for verified hosts and check the host's reliability before a long run.

Rent on Vast.ai

Referral links: RunLocalAI may earn a commission or account credits if you sign up and rent, at no extra cost to you. Hourly rates and which GPUs are listed change all the time, so check the provider's page before you start. Editorial opinions are independent of the referral relationship; see how we make money.

Related errors

Did this fix it?

If your case was different, email Contact support with what you saw and we'll update the page. If it worked but took different commands on your platform, we want to know that too.