grafana / grafana/pyroscope

Compactor traffic shaping

Open
#3,592 0 comments 0 reactions 0 assignees View on GitHub
enhancement object-storage storage v1
Dominant language
Go
Stars
11.7k
Forks
802
Avg merge
1d 19h
Merged PRs (30d)
80

Description

Due to the way merge-split compaction works, each compactor instance can put significant pressure on the network, especially if the number of compaction shards is high. To mitigate this, we should implement traffic shaping. We already have an option to limit the concurrency (`compactor.block-sync-concurrency`, which is set to 8 by default), but this isn't helpful – regardless of the number of concurrent threads, 100% of the network is utilized

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.