PostgreSQL extension that can skip faulty lines in COPY
Open
usability
- Dominant language
- C
- Stars
- 12.8k
- Forks
- 794
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 31
Description
When users load large data sets (from S3 or files), these datasets might have a few bad records. Most data warehousing solutions can be configured to skip over a predefined number of bad lines.
This has also been discussed for PostgreSQL: https://wiki.postgresql.org/wiki/Error_logging_in_COPY
This task proposes to extend COPY to skip over a configurable number of records.
Contributor guide
Assessment
This issue has not been assessed yet.