microsoft / microsoft/onnxruntime
[Feature Request] EP context cache options don't seem to work with onnxruntime perf test
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the feature request
Using session options in c++/python i am able to use Ep context options.
I tried the same using onnxruntime_perf_test but the app doesn't seem to honor these
./bin/onnxruntime_perf_test.exe -C "ep.context_enable|1 ep.context_file_path|C:/Users/nithink/IPU/w24/0805/1713/onnx-rt/out_cache/out_cache_psq1.onnx" -e vitisai -m duration -t 10 -I R:/ipu_regr/msft_models/win24_shell/shell_models_for_June_15_drop/shell/PSO0/Model-PSO0-QDQ-v1_0_1/Model-PSO0-QDQ-v1_0_1_A/b512-SyncBN-x4_rpn_batch_qdq_quant_A.onnx
-C is the session option as per documentation, when i use this i expect it to generate cached context file which is not happening
### Describe scenario use case
Compatibility with onnxruntime_perf_test so that it's easy to use by anyone
Contributor guide
Research direction
Start at the onnxruntime_perf_test entry point and trace how the -C session options are parsed and passed to the Vitis AI execution provider. Compare this behavior with the C++ and Python session-option usage described in the issue. Done means the provided command honors ep.context_enable and ep.context_file_path and generates the cached context file.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, python
- Domain
- machine-learning, performance, testing-qa
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100