pingcap / pingcap/tidb

Lightning: Suggest Adding a Retry Mechanism When Querying for Duplicate Records to Resolve

Open
#42,091 1 comment 0 reactions 0 assignees View on GitHub
component/lightning type/enhancement
Dominant language
Go
Stars
40.5k
Forks
6.2k
PR merge metrics
PR metrics pending

Description

## Enhancement
To resolve duplicate records, Lightning relies on a SELECT query to retrieve the necessary information from a metadata table. However, errors may occur during this process, such as 'Error 1105: sync load stats timeout'. Ignoring such errors can result in unresolved duplicates and potential data corruption. To address this issue, we suggest implementing a retry mechanism for the query to ensure that all duplicate data is resolved. A backoff policy could be applied to the retry process to improve the robustness of the duplicate resolution logic. This improvement will minimize the chance of errors.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.