HadoopConf loses set values when HoodieStorage.getConf is called
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
We use StorageConf to hold
hoodie.io.factory.class which is the IOFactory class that should be used for the file reader and writer factories. For now, we have added reflection into
HoodieHadoopIOFactory to get around this, but ideally we should not need to do this
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7746
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6243
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing how StorageConf values are set and retrieved through HoodieStorage.getConf, then inspect HoodieHadoopIOFactory and its reflection workaround. Reproduce the loss of hoodie.io.factory.class and verify that configured values remain available without requiring reflection.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100