abetlen / abetlen/llama-cpp-python
arm64 builds for CUDA
Open
enhancement
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 1.4k
- PR merge metrics
- PR metrics pending
Description
Many are using this library on Nvidia Jetson/Orin devices, but there are no prebuilt wheels available for CUDA arm architectures.
Could support for automated builds of these wheels be added? Thanks!
Contributor guide
Assessment
This issue has not been assessed yet.