make Error table column name configurable .
Open
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Currently ErrorTable invalid record holder column name is defaulted to `corrupt_record` using prop `ERROR_TABLE_CURRUPT_RECORD_COL_NAME`.
We should make it configuarable .
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6181
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Locate the ErrorTable implementation and the ERROR_TABLE_CURRUPT_RECORD_COL_NAME property, then trace how configuration reaches the invalid-record holder. Determine the existing test coverage for ErrorTable and update it so the configured column name is verified; done means the column name is no longer fixed to corrupt_record.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100