microsoft / microsoft/onnxruntime
[Feature Request] CANNExecutionProvider support for dynamic input shapes.
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
Currently CANNExecutionProvider always takes a long time to generate om files for different shape inputs.
This is not very friendly for nlp, recognition and other tasks.
Are there any plans to introduce CANN support for [dynamic input shapes](https://www.hiascend.com/document/detail/zh/canncommercial/800/developmentguide/graph/graphdevg/atlasag_25_0054.html)?
### Describe scenario use case
Maybe add input_format, input_shape parameters to Configuration Options.
```python
providers = [
(
"CANNExecutionProvider",
{
"device_id": 0,
"input_format": "NCHW",
"input_shape": "1~6,3,48,-1"
}
)
]
```
Contributor guide
Research direction
Start by tracing the CANNExecutionProvider configuration options and reviewing the linked CANN dynamic input shapes documentation. Determine how provider options such as input_format and input_shape should be represented and validated. Done means dynamic shapes are supported without generating separate OM files for every input shape, with coverage for the new behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100