pingcap / pingcap/tidb-operator

When the backup commit ts of multiple k8s is inconsistent, it will cause the second phase of restore to be very slow [restore for 5109]

Open
#5,786 1 comment 0 reactions 1 assignee View on GitHub

@BornChanger is already working on this.

Since Oct 25, 2024.

Dominant language
Go
Stars
1.3k
Forks
540
Avg merge
3d 2h
Merged PRs (30d)
18

Description

Bug Report

What version of Kubernetes are you using?

What version of TiDB Operator are you using?
wangle1321/tidb-operator:202305261650

What storage classes exist in the Kubernetes cluster and what are used for PD/TiKV pods?
gp3(8000 iops 800 throughput)

What's the status of the TiDB cluster pods?
normal

What did you do?
1.create cluster(cross k8s)
2.do volumebackup(3 TiKVs, each 1.5 T volume, each tikv has 600 data), but three backup commit is is different
image
image
image
3. do volume restore

What did you expect to see?

  1. volume restore success and cost less than 1h

What did you see instead?

  1. The recovery has not been completed within 4 hours,Stuck in the raft log

eedd9ed4-a72a-4495-aba0-c12b3ed50634

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.