microsoft / microsoft/onnxruntime
[Feature Request] API for callers to determine if a compiled model is compatible with a given device
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
This feature request tracks adding a new ONNX Runtime API (e.g., `CheckModelCompatibility`) which takes a path to a model as input and returns to the caller a state value which indicates the compiled model's compatibility with the underlying device.
### Describe scenario use case
An application may have a precompiled model and want some way of determining if that precompiled model is compatible with the device it's running on (i.e., specifically with relation to the EP + driver stack on the device). ONNX Runtime should supply an API where the caller can supply the path to the model and get back a state which the caller can use to determine if they need to recompile the model (e.g. due to a breaking driver update).
Contributor guide
Research direction
Start by locating ONNX Runtime's public API definitions and the code paths for loading precompiled models and interacting with the EP and driver stack. Determine how compatibility state should be represented and what callers must receive from a path-based CheckModelCompatibility API; done means the API contract and behavior are implemented and validated for driver or device incompatibility.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- api, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100