Adaptively adjust the number of running queries based on available memory
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 1k
- Forks
- 423
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 24
Description
Enhancement
Currently, the number of queries that a single TiFlash process can run simultaneously is task_scheduler_active_set_soft_limit.
When there are a large number of memory-intensive queries running concurrently, it frequently triggers "kill query".
If the number of queries running simultaneously could be adjusted based on the TiFlash process's current memory usage, the user experience in this scenario would be much improved.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names task_scheduler_active_set_soft_limit but provides no file, test, or entry point. Start by locating that setting and the TiFlash query scheduler, then determine how current process memory should control concurrency; done means memory-intensive concurrent queries no longer frequently trigger "kill query".
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100