microsoft / microsoft/onnxruntime
[Feature Request] Add official support for onnxruntime-gpu on ARM64/aarch64 platforms
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
**Issue Description**
Currently, onnxruntime-gpu package lacks official support for ARM64/aarch64 architecture, limiting GPU acceleration capabilities on increasingly popular ARM-based platforms.
**Current Situation**
No official pre-built wheels for onnxruntime-gpu on ARM64/aarch64
Limited documentation for ARM64 GPU deployment
**Technical Details**
- Environment:
Architecture: ARM64/aarch64
Platform: Various (like AWS Graviton, etc.)
Python Versions: 3.8+ compatibility needed
**Proposed Solution**
Official pre-built wheels for ARM64/aarch64
CI/CD pipeline additions for ARM64 builds
Would appreciate any feedback or guidance on how to make this happen?
### Describe scenario use case
**Use Case :**
Growing adoption of ARM64 in edge/hpc computing.
Cloud deployments on ARM64-based servers (AWS Graviton, etc.)
Machine learning workloads on newer ARM-based development machines
IoT and embedded systems requiring GPU acceleration
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The request names no files, tests, or entry points. Start by locating the existing GPU wheel and CI build entry points for Python 3.8+ and ARM64, then define the required pre-built wheels and CI coverage for the listed platforms; done means documented, reproducible ARM64/aarch64 GPU packages.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- build-system, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100