ensure Deltastreamer writes succeed if a target base path exists, but w/ no contents
Open
area:ingest
from-jira
priority:medium
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
If target table dir exists and if its empty, deltastreamer throws TableValidity exception
we might need to fix it.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-3632
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the Deltastreamer write with an existing, empty target table directory, then trace where the TableValidity exception is raised. Done means the write succeeds for an empty existing target base path without weakening validation for invalid table contents.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, stream-processing
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100