RUNLOCALAIv38
->Will it run?Best GPUCompareTroubleshootStartLearnPulseModelsHardwareToolsBench
Run check
RUNLOCALAI

Independently operated catalog for local-AI hardware and software. Hand-written verdicts. Source-cited claims. Reproducible commands when we have them.

OP·Eruo Fredoline
DIR
  • Models
  • Hardware
  • Tools
  • Benchmarks
TOOLS
  • Will it run?
  • Compare hardware
  • Cost vs cloud
  • Choose my GPU
  • Prompting kits
  • Quick answers
REF
  • All buyer guides
  • Learn local AI
  • Methodology
  • Glossary
  • Errors KB
  • Trust
EDITOR
  • About
  • Author
  • How we make money
  • Editorial policy
  • Contact
LEGAL
  • Privacy
  • Terms
  • Sitemap
MAIL · MONTHLY DIGEST
Get monthly local AI changes
Monthly recap. No spam.
DISCLOSURE

Some links on this site are affiliate links (Amazon Associates and other first-class retailers). When you buy through them, we earn a small commission at no extra cost to you. Affiliate links do not influence our verdicts — there are cards we rate highly that we don't have affiliate relationships with, and cards that sell well that we refuse to recommend. Read more →

© 2026 runlocalai.coIndependently operated
RUNLOCALAI · v38
Errors / CUDA / NVIDIA / PyTorch: CUDA error: no kernel image is available for execution on the device
CUDA / NVIDIA

PyTorch: CUDA error: no kernel image is available for execution on the device

RuntimeError: CUDA error: no kernel image is available for execution on the device
By Eruo Fredoline · Last verified May 8, 2026

Cause

PyTorch was compiled for a set of CUDA compute capabilities (sm_70, sm_80, sm_86, sm_90, ...). Your GPU's capability isn't in that set. Common scenarios: a Blackwell GPU (sm_120) on a PyTorch built only up to sm_90; an older Pascal GPU (sm_61) on a PyTorch that dropped pre-sm_70 support.

Solution

1. Identify your GPU's compute capability:

nvidia-smi --query-gpu=name,compute_cap --format=csv

Common values: RTX 5090 = 12.0 (sm_120), RTX 40 = 8.9, RTX 30 = 8.6, A100 = 8.0, H100 = 9.0.

2. For new GPUs (Blackwell / RTX 50), use a PyTorch nightly with sm_120 support:

pip install --pre torch torchvision --index-url https://download.pytorch.org/whl/nightly/cu128

3. For old GPUs (pre-sm_70: GTX 10xx, GP100, K80), downgrade to PyTorch ≤ 2.1, which still ships pre-Volta kernels:

pip install "torch<2.2" "torchvision<0.17" --index-url https://download.pytorch.org/whl/cu118

4. For some installs you can override the target architecture at install time (works only when building from source):

TORCH_CUDA_ARCH_LIST="12.0" pip install torch --no-binary :all:

5. Check the PyTorch version's supported arch list:

import torch
print(torch.cuda.get_arch_list())
# Should include your GPU's sm_XX

Related errors

  • vLLM install picks the wrong CUDA wheel
  • RuntimeError: CUDA error: device-side assert triggered
  • CUDA runtime version doesn't match the installed driver

Did this fix it?

If your case was different, email Contact support with what you saw and we'll update the page. If it worked but took different commands on your platform, we want to know that too.