microsoft / microsoft/onnxruntime
[Feature Request] Support linux/arm64 wheels for onnxruntime-gpu
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
There are CUDA enabled devices like Nvidia jetson which uses arm64 processors.
Currently, onnxruntime-gpu doesnt support arm64 processors.
Could we enable support for them?
### Describe scenario use case
There are a lot of tools which uses onnxruntime-gpu under the hood, since arm64 isnt supported in onnxruntime-gpu, all those tools cannot support arm64 processors.
Publishing arm64 wheels for onnxruntime-gpu would enable all those tools to support arm64 processors
Contributor guide
Research direction
No files, tests, or entry points are named. Start by locating the wheel-building and platform-support entry points for onnxruntime-gpu, then determine the Linux/arm64 CUDA requirements and how existing wheels are produced. Done means arm64 GPU wheels can be built, published, and validated for the stated Jetson use case.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, linux
- Domain
- build-system, embedded-iot, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100