pingcap / pingcap/tidb

Unlimited high concurrent access to TiFlash may make TiFlash crash when using dynamic partition prune mode

Open
#35,864 1 comment 0 reactions 0 assignees View on GitHub
sig/execution type/enhancement
Dominant language
Go
Stars
40.5k
Forks
6.2k
PR merge metrics
PR metrics pending

Description

## Enhancement

In TiDB, when dynamic partition prune mode is enabled, and if there is a full table scan for a partition table in TiFlash, assuming the partition table has n partitions, and if TiDB access TiFlash in cop mode, then the accessing concurrency will be
`n * dist_scan_concurrency`
That is to say the accessing concurrency will increase linearly if the total partition number increase. These unlimited high concurrent access to TiFlash may make TiFlash crash, we need find a way to limit the overall accessing concurrency.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.