ONNX Runtime Mobile
Microsoft's ONNX Runtime packaged for Android and iOS apps, with NNAPI, CoreML and XNNPACK acceleration. The default mobile packages carry the full operator set; a custom build can cut them down to the operators a model needs, reducing binary size.
Overview
Microsoft's ONNX Runtime packaged for Android and iOS apps, with NNAPI, CoreML and XNNPACK acceleration. The default mobile packages carry the full operator set; a custom build can cut them down to the operators a model needs, reducing binary size.
Pros
- Prebuilt Android and iOS packages (onnxruntime-android, onnxruntime-c, onnxruntime-objc)
- Microsoft-maintained
- CoreML on iOS; NNAPI on Android; XNNPACK on both
Cons
- Toolchain assumes ONNX intermediate format — Hugging Face → ONNX conversion is an extra step
- iOS path narrower than CoreML or MLC LLM
- NNAPI can fall back to its own CPU implementation for operations the GPU or NPU does not support, which is often less efficient than ONNX Runtime's
Compatibility
| Operating systems | Android iOS |
| GPU backends | NNAPI CoreML |
| License | Open source · free + open-source |
Runtime health
Operator-grade signals on how actively ONNX Runtime Mobile is being maintained, how fresh its measurements are, and what failure classes operators have flagged. Every label below is anchored to a real date or count — we never infer maintainer activity we can't show.
Release cadence
Derived from the most recent editorial signal on this row.
2 days since last refresh · source: lastUpdated
Benchmark freshness
How recent the editorial measurements on this runtime are.
No editorial benchmarks for this runtime yet.
Community reproduction
Submissions that match an editorial measurement on similar hardware.
No community reproductions on file yet.
Get ONNX Runtime Mobile
Frequently asked
Is ONNX Runtime Mobile free?
What operating systems does ONNX Runtime Mobile support?
Which GPUs work with ONNX Runtime Mobile?
Reviewed by RunLocalAI Editorial. See our editorial policy for how we evaluate tools.
Related — keep moving
Verify ONNX Runtime Mobile runs on your specific hardware before committing money.