microsoft / microsoft/onnxruntime
[Feature Request]
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
In the python apis, I see [run_async](https://onnxruntime.ai/docs/api/python/api_summary.html#onnxruntime.InferenceSession.run_async) and also I see [run_with_iobinding](https://onnxruntime.ai/docs/api/python/api_summary.html#onnxruntime.InferenceSession.run_with_iobinding). Is it possible to use the async apis with io binding ?
### Describe scenario use case
In a typical python server, having an efficient async apis wouldn't block the server main thread.
Contributor guide
Research direction
Start with the Python API documentation for InferenceSession.run_async and InferenceSession.run_with_iobinding. Determine whether asynchronous execution can support I/O binding for the described Python server scenario, and define the API behavior and documentation needed for the request to be complete.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100