Improving FileIndex load performance in PARALLELISM mode
Open
area:index
from-jira
priority:high
status:pr-available
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 112
Description
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5175
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the Hudi-5175 JIRA issue and search the repository for the FileIndex implementation and PARALLELISM mode entry points. Establish a baseline for FileIndex load performance, then identify the intended improvement and define completion using comparable measurements in parallelism mode.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100