microsoft / microsoft/onnxruntime

[Documentation] Optimizations and dependence on hardware

Open
#15,529 1 comment 0 reactions 0 assignees View on GitHub
documentation
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the documentation issue

Am I correct in assuming that since extended optimizations are applied to nodes with a certain EP, then they are dependent on hardware?

So, if I'm understanding correctly, does that mean extended optimizations are best applied at runtime, i.e. in this case only in online mode, and offline mode is not available, because there may be performance problems?

Thanks in advance.

### Page / URL

https://onnxruntime.ai/docs/performance/model-optimizations/graph-optimizations.html#extended-graph-optimizations

Contributor guide

Open the contributing guide

Research direction

Start with the extended graph optimizations section at the linked graph-optimizations.html page and review how execution providers and online/offline optimization are described there. Clarify whether the optimizations depend on hardware or the selected provider, and document the correct runtime guidance so the page answers both questions.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.