apache / apache/hudi

Move wrapper file system and other Hudi storage logic to HoodieStorage implementation

Open
#17,090 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Wrapper FS and retries are implemented through FileSystem. These belong to HoodieStorage layer. We'll create a new HoodieWrapperStorage(?) to reflect such logic.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-9595
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the FileSystem implementation of wrapper FS and retries, then inspect the HoodieStorage abstraction and the proposed HoodieWrapperStorage. Done means this storage logic is represented in the HoodieStorage layer rather than through FileSystem, with the affected behavior still covered by the project's existing tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.