intel / intel/AI-Playground

add openvino as a backend choice.

Open
#159 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
979
Forks
132
Avg merge
9h 23m
Merged PRs (30d)
8

Description

## how about adding openvino as a backend choice.

Current backend is fixed on pytorch or ipex, which means customers have no other choice. If other backend can provide better perf or scaling, why not support such backend?

## add an extension api, which allowing external developers contribute or integrate better backend into AI-Playground.

Usually, users select specific model, type inputs, click run button and get the output. It means AI-Playground should provide the best outputs to the users. Users doesn't care about what's going on the background.

But AI-Playground cannot make sure current inference engine is fastest, right? So, why not leave an open api for external developers to integrate other excellent inference engine?

## Describe alternatives you've considered

AI-Playground can make a decision on which inference engine is used in each release binary. If pytorch is better, this release use pytorch. If openvino is better, this release use openvino.

Leave the pressure on the backend teams and keep the race going.
If so, each release perf and scaling should be better than the last release.

## Additional context

N/A

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.