microsoft / microsoft/onnxruntime

[Feature Request] Support linux/arm64 wheels for onnxruntime-gpu

Open
#21,232 1 comment 0 reactions 0 assignees View on GitHub
ep:CUDA feature request platform:jetson
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

There are CUDA enabled devices like Nvidia jetson which uses arm64 processors.

Currently, onnxruntime-gpu doesnt support arm64 processors.

Could we enable support for them?

### Describe scenario use case

There are a lot of tools which uses onnxruntime-gpu under the hood, since arm64 isnt supported in onnxruntime-gpu, all those tools cannot support arm64 processors.

Publishing arm64 wheels for onnxruntime-gpu would enable all those tools to support arm64 processors

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by locating the wheel-building and platform-support entry points for onnxruntime-gpu, then determine the Linux/arm64 CUDA requirements and how existing wheels are produced. Done means arm64 GPU wheels can be built, published, and validated for the stated Jetson use case.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, linux
Domain
build-system, embedded-iot, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.