pingcap / pingcap/tidb

Lightning: Source File Opening Problems not Discovered in Pre-check Phase

Open
#33,740 2 comments 0 reactions 0 assignees View on GitHub
component/lightning severity/minor type/bug
Dominant language
Go
Stars
40.5k
Forks
6.2k
PR merge metrics
PR metrics pending

Description

## Bug Report

Please answer these questions before submitting your issue. Thanks!

### 1. Minimal reproduce step (Required)

* Create a very small parquet file, and make Lightning unable to open it (For example, make Lightning have no privilege to access it)
* Add this file to the source files for Lightning to import
* Set `lightning.check-requirements` to `false` in the Lightning task config
* Begin to import into TiDB using Lightning

### 2. What did you expect to see? (Required)
The source file opening error should be discovered at the pre-check phase.

### 3. What did you see instead (Required)
The source file opening error occurs during restoring the table.

### 4. What is your TiDB version? (Required)
5.7.25-TiDB-v6.0.0-alpha-84-gc369ad9-dirty ( latest version also has this limitation )

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.