Improve listing based rollback to use metadata table if commit is available
Open
area:metadata-table
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
as of now, Listing based rollback strategy uses FS listing. we can optimize it to use MDT if commit is present in MDT. else fallback to FS based listing.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5395
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the Listing based rollback strategy and its current FS-listing path in the Hudi repository. Verify the MDT commit-availability condition and ensure the completed change uses MDT when the commit is present, with FS listing as the fallback when it is absent.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100