Compactor traffic shaping
Open
enhancement
object-storage
storage
v1
- Dominant language
- Go
- Stars
- 11.7k
- Forks
- 802
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 80
Description
Due to the way merge-split compaction works, each compactor instance can put significant pressure on the network, especially if the number of compaction shards is high. To mitigate this, we should implement traffic shaping. We already have an option to limit the concurrency (`compactor.block-sync-concurrency`, which is set to 8 by default), but this isn't helpful – regardless of the number of concurrent threads, 100% of the network is utilized
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.