apache / apache/hudi

Reduce number of constructors in HoodieHadoopStorage

Open
#16,463 1 comment 0 reactions 0 assignees View on GitHub
area:code-quality from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

HoodieHadoopStorage has a bunch of constructors because HadoopFSutils.getFs has a lot different versions. Reduce the number of different constructors (and getFs too if you can) to a reasonable number.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7732
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6243

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating HoodieHadoopStorage and HadoopFSutils.getFs, then inspect their constructors, overloads, and existing call sites. Compare the versions needed by callers and preserve current filesystem behavior while consolidating redundant entry points. Done means a reasonable reduction in constructors and, where practical, getFs variants without breaking existing usage.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.