microsoft / microsoft/onnxruntime

[Feature Request] EP context cache options don't seem to work with onnxruntime perf test

Open
#21,850 2 comments 0 reactions 0 assignees View on GitHub
ep:VitisAI feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

Using session options in c++/python i am able to use Ep context options.
I tried the same using onnxruntime_perf_test but the app doesn't seem to honor these

./bin/onnxruntime_perf_test.exe -C "ep.context_enable|1 ep.context_file_path|C:/Users/nithink/IPU/w24/0805/1713/onnx-rt/out_cache/out_cache_psq1.onnx" -e vitisai -m duration -t 10 -I R:/ipu_regr/msft_models/win24_shell/shell_models_for_June_15_drop/shell/PSO0/Model-PSO0-QDQ-v1_0_1/Model-PSO0-QDQ-v1_0_1_A/b512-SyncBN-x4_rpn_batch_qdq_quant_A.onnx

-C is the session option as per documentation, when i use this i expect it to generate cached context file which is not happening

### Describe scenario use case

Compatibility with onnxruntime_perf_test so that it's easy to use by anyone

Contributor guide

Open the contributing guide

Research direction

Start at the onnxruntime_perf_test entry point and trace how the -C session options are parsed and passed to the Vitis AI execution provider. Compare this behavior with the C++ and Python session-option usage described in the issue. Done means the provided command honors ep.context_enable and ep.context_file_path and generates the cached context file.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, python
Domain
machine-learning, performance, testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.