pingcap / pingcap/tiflash

How long does it takes to sync plenty of `ADD COLUMN` DDL to a partitioned table with many partitions

Open
#9,061 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

type/question
Dominant language
C++
Stars
1k
Forks
423
Avg merge
1d 15h
Merged PRs (30d)
24

Description

General Question

In the v5.4 version, we observed that executing 30 ADD COLUMN DDL to a partitioned table with 450 partitions cause more than 1 minute. And this will make all the queries to TiFlash stuck until the schema sync is done.

Since v7.2, we have a new DDL framework, which is to expected to:

  • Shorten the duration of TiFlash Schema Sync with TiDB
  • Mitigate the problem of blocking other queries to the tables that is not relevant to the DDLs

We want to confirm how long executing 30 ADD COLUMN DDL to a partitioned table with 450 partitions takes after v7.5.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the reported workload: 30 ADD COLUMN DDL statements on a partitioned table with 450 partitions, using the post-v7.2 DDL framework targeted by the report. Measure schema-sync duration and whether TiFlash queries remain blocked, then document the results for the v7.5 comparison requested.

Written by the indexing model from the issue text.

Assessment

Tech stack
sql
Domain
databases, performance
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.