RUNLOCALAIv38
→WILL IT RUNBEST GPUCOMPARETROUBLESHOOTSTARTPULSEMODELSHARDWARETOOLSBENCH
RUNLOCALAI

Operator-grade instrument for local-AI hardware intelligence. Hand-written verdicts. Real benchmarks. Reproducible commands.

OP·Fredoline Eruo
DIR
  • Models
  • Hardware
  • Tools
  • Benchmarks
  • Will it run?
GUIDES
  • Best GPU
  • Best laptop
  • Best Mac
  • Best used GPU
  • Best budget GPU
  • Best GPU for Ollama
  • Best GPU for SD
  • AI PC build $2K
  • CUDA vs ROCm
  • 16 vs 24 GB
  • Compare hardware
  • Custom compare
REF
  • Systems
  • Ecosystem maps
  • Pillar guides
  • Methodology
  • Glossary
  • Errors KB
  • Troubleshooting
  • Resources
  • Public API
EDITOR
  • About
  • About the author
  • Changelog
  • Latest
  • Updates
  • Submit benchmark
  • Send feedback
  • Trust
  • Editorial policy
  • How we make money
  • Contact
LEGAL
  • Privacy
  • Terms
  • Sitemap
MAIL · MONTHLY DIGEST
Get monthly local AI changes
Monthly recap. No spam.
DISCLOSURE

Some links on this site are affiliate links (Amazon Associates and other first-class retailers). When you buy through them, we earn a small commission at no extra cost to you. Affiliate links do not influence our verdicts — there are cards we rate highly that we don't have affiliate relationships with, and cards that sell well that we refuse to recommend. Read more →

SYS · ONLINEUPTIME · 100%2026 · operator-owned
RUNLOCALAI · v38
  1. >
  2. Home
  3. /Tools
  4. /ONNX Runtime Mobile
runner
Open source
free + open-source

ONNX Runtime Mobile

Microsoft's mobile/edge variant of ONNX Runtime. The reference path for Snapdragon X / Lunar Lake / Ryzen AI on Windows + Copilot+ PC NPU acceleration. Mobile builds drop ops not used in inference to keep binary size small.

By Fredoline Eruo·Last verified May 7, 2026·16,000 GitHub stars

Overview

Microsoft's mobile/edge variant of ONNX Runtime. The reference path for Snapdragon X / Lunar Lake / Ryzen AI on Windows + Copilot+ PC NPU acceleration. Mobile builds drop ops not used in inference to keep binary size small.

Pros

  • First-class Windows Copilot+ PC NPU support
  • Microsoft-maintained — ships with Windows AI features
  • DirectML provider on Windows; CoreML on iOS; NNAPI on Android

Cons

  • Toolchain assumes ONNX intermediate format — Hugging Face → ONNX conversion is an extra step
  • iOS path narrower than CoreML or MLC LLM
  • Android NNAPI path lags MLC LLM on LLM benchmarks

Compatibility

Operating systems
Android
iOS
Windows
GPU backends
NPU
DirectML
CoreML
LicenseOpen source · free + open-source

Runtime health

Operator-grade signals on how actively ONNX Runtime Mobile is being maintained, how fresh its measurements are, and what failure classes operators have flagged. Every label below is anchored to a real date or count — we never infer maintainer activity we can't show.

Release cadence

Derived from the most recent editorial signal on this row.

Active
Updated May 7, 2026

6 days since last refresh · source: lastUpdated

Benchmark freshness

How recent the editorial measurements on this runtime are.

0editorial benchmarks

No editorial benchmarks for this runtime yet.

Community reproduction

Submissions that match an editorial measurement on similar hardware.

0reproduced reports

No community reproductions on file yet.

Get ONNX Runtime Mobile

Official site
https://onnxruntime.ai/docs/tutorials/mobile/
GitHub
https://github.com/microsoft/onnxruntime

Frequently asked

Is ONNX Runtime Mobile free?

ONNX Runtime Mobile has a paid tier (free + open-source). Check the pricing page for current terms.

What operating systems does ONNX Runtime Mobile support?

ONNX Runtime Mobile supports Android, iOS, Windows.

Which GPUs work with ONNX Runtime Mobile?

ONNX Runtime Mobile supports NPU, DirectML, CoreML. CPU-only inference is also possible but slow.
See something off?Report outdated·Suggest a correctionWe read every submission. Editorial review takes 1-7 days.

Reviewed by RunLocalAI Editorial. See our editorial policy for how we evaluate tools.

Related — keep moving

Compare hardware
  • RTX 3090 vs RTX 4090 →
  • Apple M4 Max vs RTX 4090 →
Buyer guides
  • Best GPU for local AI →
  • Best budget GPU →
When it doesn't work
  • llama.cpp too slow →
  • llama.cpp build failed →
  • llama.cpp Metal crash (Mac) →
  • GGUF tokenizer mismatch →
Recommended hardware
  • RTX 3090 (used) →
  • Apple M4 Max →
Alternatives
MLX-LMExLlamaV2llama.cppLlamafileOllamaIPEX-LLMCTranslate2Intel OpenVINO
Before you buy

Verify ONNX Runtime Mobile runs on your specific hardware before committing money.

Will it run on my hardware? →Custom hardware comparison →GPU recommender (4 questions) →