microsoft / microsoft/onnxruntime
Execution Provider bridge for TFLite Delegates for Coral Edge TPUs
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 8h
- Merged PRs (30d)
- 179
Description
ONNX Runtime cannot yet target Coral Edge TPU accelerators.
Coral normally uses Tensorflow Lite with a loadable TFLite Delegate that communicates with the hardware called libedgetpu.
It appears that the goals of ONNX Runtime Execution Providers and TFLite Delegates are similar so perhaps it would be possible to create a wrapper to bridge the APIs (docs). If such a bridge existed it would be possible to target Edge TPU devices.
TFLite can also target some of the same accelerators as ONNX Runtime (NNAPI, CoreML, etc.). Having the bridge could also be useful for debugging issues by reproducing them on an alternative code path.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the ONNX Runtime Execution Providers documentation and TensorFlow Lite's delegate implementation guidance. Compare those APIs with Coral's libedgetpu and determine whether a bridge can target Edge TPU devices. Done means a defined, working bridge, with its feasibility and supported accelerator paths documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, tensorflow
- Domain
- ai-infra-agents, embedded-iot, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100