ClickHouse / ClickHouse/ClickHouse

Huge increase in max parts per partition after upgrade to CH 24.4.1.2088

Open
#63,717 4 comments 0 reactions 0 assignees View on GitHub
comp-background-ops cripshnot external st-need-info unexpected behaviour
Dominant language
C++
Stars
49.9k
Forks
9k
Avg merge
21h 32m
Merged PRs (30d)
515

Description

As the title says, after upgrading to latest CH version 24.4.1.2088, from 24.3.3.102, we noticed a huge increase in CPU load on the CH cluster, and upon further investigation it seems to come from the parts merges. I've also noticed that we have a huge increase in max parts per partitions since the upgrade, please see the attached screenshot.

I could also not correlate it to any documented change in the release notes, but perhaps it's there and you could point me in the right direction for tuning something that changed between these 2 releases? We're using the ReplicatedGraphiteMergeTree engine, if it makes any difference.
![2024-05-13_18-16](https://github.com/ClickHouse/ClickHouse/assets/2210021/ac42398e-c6c6-4684-8234-1e823072cd39)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.