microsoft / microsoft/onnxruntime

[Feature Request] Add a more detailed OrtStatus for diagnosing model compilation incompatibilities

Open
#25,314 0 comments 0 reactions 0 assignees View on GitHub
feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

Adding an OrtStatus value (possibly to the `GetCapability` API [here](https://github.com/microsoft/onnxruntime/blob/main/include/onnxruntime/core/session/onnxruntime_ep_c_api.h#L357)) to help identify cases where compiled models are not runnable on the device where an app may be running.

### Describe scenario use case

An app that is using a precompiled model will use it via creating a new session. It's possible that this operation might fail due to incompatibilities with the device. Giving the application a granular status code that indicates the session creation failed due to this would help with diagnosability.

Contributor guide

Open the contributing guide

Research direction

Start with include/onnxruntime/core/session/onnxruntime_ep_c_api.h and the GetCapability API referenced in the issue. Trace how session creation reports failures for precompiled models that are incompatible with the device. Done means the project has agreed on and exposes a granular OrtStatus for this incompatibility case, with coverage for the resulting behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
api, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.