microsoft / microsoft/onnxruntime

[Feature Request] Add support for upstream "Rocket" rknpu driver

Open
#26,967 0 comments 6 reactions 0 assignees View on GitHub
feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

As of kernel 6.18, the "Rocket" rknpu driver is upstream, please add support for it as an execution provider. I am not a dev, I just want this so Immich can use it.

### Describe scenario use case

People who want to use the upstream kernel on an RK3588 machine but are forced to use downstream because the RKNN driver is only available for 6.1

Would it be possible to implement it using the tensorflow logic for NVidia? https://docs.mesa3d.org/teflon.html

Contributor guide

Open the contributing guide

Research direction

Start by locating ONNX Runtime's execution-provider implementations and the TensorFlow/NVIDIA logic referenced in the issue, then determine what the upstream Rocket rknpu driver exposes on RK3588 with kernel 6.18. Done means ONNX Runtime can use Rocket as an execution provider; the issue names no files or tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, linux, tensorflow
Domain
embedded-iot, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.