Allow Vectorized Reading for bootstrap in the new fg reader under some conditions
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Vectorized reading can be used for bootstrap if we don't need to do any merging. Additionally, it can be used if no filters are pushed down. With row index positions, some pushdown filtering could even be allowed
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7693
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6242
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the new fg reader's bootstrap path and the existing decisions for merging, pushed-down filters, and row index positions. The work is done when bootstrap uses vectorized reading under the stated no-merge and filter conditions, with any row-index-based filtering behavior covered by the reader's existing validation or tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100