influxdata / influxdata/influxdb

Config - CompactThroughputBurst - Setting lower than default CompactThroughput is not accepted

Open
#21,224 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
31.7k
Forks
3.7k
Avg merge
13h 37m
Merged PRs (30d)
8

Description

Hi,

We are required to lower the IO of influx during compactions, however this does not seem possible in `v2.0.4` due to the following:

Only `CompactThroughputBurst` is exposed via config, not `CompactThroughput`. The configured `CompactThroughputBurst` is overriden during start-up to the default `48mb` of `CompactThroughput`. Thus setting `CompactThroughputBurst` lower than `48mb` has no effect.

https://github.com/influxdata/influxdb/blob/540bb66e1381a48a6d1ede4fc3e49c75a7d9f4af/tsdb/store.go#L264-L278

How would we go about it, exposing `CompactThroughput` or allowing lower than `48mb` for `CompactThroughputBurst`, though I'm unsure of just setting `Burst` is enough to lower the IO?

Thank you,
Marco Muller

Contributor guide

Open the contributing guide

Research direction

Start by reading tsdb/store.go around lines 264-278 to trace how CompactThroughputBurst is initialized and overridden during startup. Determine the intended configuration behavior and verify that a lower configured throughput is honored without breaking compaction settings; no test file is named in the issue.

Written by the indexing model from the issue text.

Assessment

Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.