cockroachdb / cockroachdb/cockroach

sql: IMPORT INTO should support writing rows that fail importing into a file

Open
#95,895 0 comments 0 reactions 0 assignees View on GitHub
A-import C-enhancement T-sql-queries
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

In the field, large imports are frequently done. Right now, once retries for an import job is exhausted, the import job is paused.

IMPORT INTO should have an [import option](https://www.cockroachlabs.com/docs/stable/import-into.html) called `rejected_rows_file`. When importing a particular row fails, that row should get logged into the rejection file and the import process should continue importing the rest of the data while ignoring any failed rows once the retries are exhausted.

Jira issue: CRDB-23798

Epic CRDB-23802

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.