Audit all base file readers and replace w/ file slice readers
Open
area:reader
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
If file slice reader is as performant as a base file reader when there are no log files, we should replace all base file readers w/ file slice readers.
Just so we unify both COW and MOR code paths
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7756
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating all base file reader and file slice reader implementations and their call sites. Compare their behavior and performance when no log files are present, then trace both COW and MOR paths to identify every replacement needed. Done means the paths use file slice readers consistently without regressions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100