pingcap / pingcap/tidb

Lightning doesn't fail fast when import talbe fails

Open
#33,587 4 comments 0 reactions 1 assignee Claimed by @sleepymole View on GitHub
component/lightning type/enhancement
Dominant language
Go
Stars
40.5k
Forks
6.2k
PR merge metrics
PR metrics pending

Description

## Bug Report

Please answer these questions before submitting your issue. Thanks!

### 1. Minimal reproduce step (Required)
1. Do a lightning import for 100 tables for examples
2. After 50 tables imported, lightning encountered an error like S3 access error and import table failed
3. Check lightning status

### 2. What did you expect to see? (Required)
- When lightning import tables fails, lightning should exit.

### 3. What did you see instead (Required)
- Currently, when lightning encountered an error in the middle, lighting will do checksum & analyze table for the tables which are already imported, before lightning exit. If there are lots of tables already imported, it could take lots of time, and not able to fail fast.
This is not good especially for DBaaS users, as in DBaaS scenario, user it not able to resume from checkpoint, so checksum & analyze table is a waste of time.

### 4. What is your TiDB version? (Required)
6.0.0

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.