microsoft / microsoft/onnxruntime

[Feature Request] Flags in OrtThreadPoolParams to allow scheduling policy/priority inheritance for created threads

Open
#13,801 0 comments 0 reactions 0 assignees View on GitHub
core runtime feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

Add flags/parameters to OrtThreadPoolParams, allowing the setup of scheduling policies (Linux) and priorities/nice (Linux, Windows).

### Describe scenario use case

We are working in a low latency environment, the parent application (Linux) is working with RT-Policies to cut latencies.
Unfortunately the pthreads are created with default settings, which significantly lowers their priority, compared to the main application.

Edit:
The threads are using the parents priority and scheduler. I did a mistake while investigating. But being able to set those parameters would be good anyway.

Contributor guide

Open the contributing guide

Research direction

Start by locating OrtThreadPoolParams and the thread-creation code it controls. Compare the requested Linux and Windows scheduling and priority behavior, then clarify the flag and parameter semantics with maintainers. Done means the supported settings are implemented, documented, and covered by platform-appropriate tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, linux
Domain
operating-systems, performance
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.