microsoft / microsoft/onnxruntime
[Feature Request] Add support for upstream "Rocket" rknpu driver
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
As of kernel 6.18, the "Rocket" rknpu driver is upstream, please add support for it as an execution provider. I am not a dev, I just want this so Immich can use it.
### Describe scenario use case
People who want to use the upstream kernel on an RK3588 machine but are forced to use downstream because the RKNN driver is only available for 6.1
Would it be possible to implement it using the tensorflow logic for NVidia? https://docs.mesa3d.org/teflon.html
Contributor guide
Research direction
Start by locating ONNX Runtime's execution-provider implementations and the TensorFlow/NVIDIA logic referenced in the issue, then determine what the upstream Rocket rknpu driver exposes on RK3588 with kernel 6.18. Done means ONNX Runtime can use Rocket as an execution provider; the issue names no files or tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, linux, tensorflow
- Domain
- embedded-iot, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100