gchq / gchq/sleeper

Set a range for compaction batch size

Open
#584 0 comments 0 reactions 0 assignees View on GitHub
compactions-module
Dominant language
Java
Stars
107
Forks
29
Avg merge
19h 46m
Merged PRs (30d)
141

Description

The table property `sleeper.table.compaction.files.batch.size` acts as both a minimum number of files which will trigger a compaction job to be created, and the maximum number of files which will be processed in a single compaction job. We'd like to split those out into two properties and update the logic for compaction job creation.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.