microsoft / microsoft/onnxruntime

[Feature Request] Is there any way to use OpenVINO EP and TensorRT EP in the same environment?

Open
#18,790 2 comments 0 reactions 0 assignees View on GitHub
ep:OpenVINO ep:TensorRT feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

I'm using python, I know if I want to use TensorRT EP, I have to use onnxruntime-gpu. If I want to use OPENVINO I have to use onnxruntime-openvino. But These cannot be installed in the same docker container. They overlap each other. I want to use both while don't want to build from source.

### Describe scenario use case

We use both CPU and GPU for inference of a model. And we want to use a single docker image.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by reviewing how the onnxruntime-gpu and onnxruntime-openvino Python packages are built and installed in a Docker container; done would be a documented supported way to use both execution providers without building from source.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python
Domain
devops, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.