br: increase the backup file uploading speed
Open
affects-8.5
component/br
severity/major
type/enhancement
- Dominant language
- Go
- Stars
- 40.5k
- Forks
- 6.2k
- PR merge metrics
- PR metrics pending
Description
## Enhancement
Issue https://github.com/tikv/tikv/issues/17150 exposed a problem that currently, backup file generated by TiKV is uploaded to external storage by single io worker for log backup. And it could be a bottleneck. We need to lift the constraint and make a more adaptive network io flow control.
Contributor guide
Research direction
Start by reading the linked TiKV issue 17150 and tracing the log-backup path that uploads backup files to external storage. Determine how the single I/O worker constrains uploads and define adaptive network I/O flow control; done means the bottleneck is removed without losing backup correctness.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- databases, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100