microsoft / microsoft/onnxruntime-genai
Running in nvidia agx orin jetpack7.2
Open
- Dominant language
- C++
- Stars
- 1.1k
- Forks
- 354
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 85
Description
Will there be a CUDA version that supports the aarch64 architecture? Right now, i can download onnxruntime-genai, but it doesn’t have CUDA support.
Contributor guide
No contributing guide indexed for this repository
Research direction
The report names NVIDIA AGX Orin, JetPack 7.2, CUDA, and aarch64 but no files or tests. Begin by checking how this repository builds and packages CUDA support, then define the supported aarch64 target and a validation path for onnxruntime-genai with CUDA.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- ai, embedded-iot
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100