Revisit HoodieSparkXXDataSourceV2ToV1Fallback
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Addressing https://github.com/apache/hudi/pull/12772#discussion_r2074437722
Revisit the classes {{{}HoodieSpark33DataSourceV2ToV1Fallback{}}}, {{{}HoodieSpark34DataSourceV2ToV1Fallback{}}}, {{{}HoodieSpark35DataSourceV2ToV1Fallback{}}}, and {{{}HoodieSpark40DataSourceV2ToV1Fallback{}}}. If there is no difference, we should unify them into a single class in Hudi spark common module.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9404
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the four named HoodieSparkXXDataSourceV2ToV1Fallback classes and the referenced pull request discussion. Compare their implementations and inspect the Hudi spark common module to determine whether they differ; done means unifying them into one class when no meaningful difference remains.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, distributed-systems
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 52/100