add openvino as a backend choice.
- Dominant language
- TypeScript
- Stars
- 979
- Forks
- 132
- Avg merge
- 9h 23m
- Merged PRs (30d)
- 8
Description
## how about adding openvino as a backend choice.
Current backend is fixed on pytorch or ipex, which means customers have no other choice. If other backend can provide better perf or scaling, why not support such backend?
## add an extension api, which allowing external developers contribute or integrate better backend into AI-Playground.
Usually, users select specific model, type inputs, click run button and get the output. It means AI-Playground should provide the best outputs to the users. Users doesn't care about what's going on the background.
But AI-Playground cannot make sure current inference engine is fastest, right? So, why not leave an open api for external developers to integrate other excellent inference engine?
## Describe alternatives you've considered
AI-Playground can make a decision on which inference engine is used in each release binary. If pytorch is better, this release use pytorch. If openvino is better, this release use openvino.
Leave the pressure on the backend teams and keep the race going.
If so, each release perf and scaling should be better than the last release.
## Additional context
N/A
Contributor guide
Assessment
This issue has not been assessed yet.