Use filegroup reader for all internal reading that requires merging
Open
area:reader
area:writer
component:clustering
component:compaction
from-jira
priority:critical
type:devtask
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Clustering, compaction, and global index change partitions, mdt, all use different ways of reading a filegroup. This is bad because there are minor differences in behavior and there is a lot of duplicate code doing pretty much the same thing
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8283
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9117
- Fix version(s):
- 1.1.0
---
## Comments
19/Nov/24 04:31;vinoth; this is the main purpose of investing in a fg reader. ;;;
---
19/Nov/24 04:32;vinoth;Whats the level of effort to do these and see if tests pass?;;;
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.