microsoft / microsoft/onnxruntime
[Feature Request] Distributed cuda x86 but not aarch64 linux
Open
ep:CUDA
feature request
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
I've seen that onnxruntime distribute with cuda x86 but not for aarch64 cuda. Like spark, thor etc
### Describe scenario use case
DGX Spark, Thor, GB200, GH200 etc
Contributor guide
Research direction
No source file or test is named. Start by reviewing how ONNX Runtime currently distributes CUDA builds for x86 Linux, then compare the packaging and build paths for aarch64 Linux. Done means an agreed, tested distribution path for CUDA on the listed aarch64 platforms.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, linux
- Domain
- build-system, machine-learning, operating-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100