microsoft / microsoft/onnxruntime
[Feature Request] Expose `CreateEnvWithGlobalThreadPools` from the Python API
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
Requesting to expose CreateEnvWithGlobalThreadPools functionality in the Python API.
### Describe scenario use case
`CreateEnvWithGlobalThreadPools`, introduced by https://github.com/microsoft/onnxruntime/pull/3177 , is useful when serving multiple models.
It seems that the C# API exposes this functionality ( https://github.com/microsoft/onnxruntime/pull/14723 ).
Contributor guide
Research direction
Start by locating CreateEnvWithGlobalThreadPools in the existing C++ API and comparing the C# exposure referenced in the issue with Python environment creation. Done means the functionality is exposed through the Python API for the multiple-model serving scenario described.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- backend-api-design, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100