Support Build Partition Record Index from Global Record Index
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
The Partitioned RLI is supported in Hudi 1.1. For any users, who want to migrate from Global RLI to Partitioned RLI. Apache Hudi should provide two things.
1. Efficient tool to build Partitioned RLI from Global RLI. Even HudieIndexer can build partitioned RLI from data. It is not efficient compare to build from Global RLI.
2. Reliable migration guidance for customers to migrate from Global RLI to Partitioned RLI without the interruption of production readers
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by examining the existing HudieIndexer flow and the current Global RLI and Partitioned RLI implementations. Determine how a Partitioned RLI can be built from a Global RLI and review migration behavior for production readers. Done means an efficient build path and documented guidance for an interruption-free migration are defined.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100