apache / apache/hudi

Spark Bootstrap implement bucket index

Open
#16,003 0 comments 0 reactions 0 assignees View on GitHub
area:index component:bootstrap engine:spark from-jira priority:medium type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

bucket index does not work with bootstrap currently

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6323
- Type: New Feature

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with JIRA HUDI-6323 and trace the Spark bootstrap and bucket-index entry points in the repository. Identify the existing bootstrap path and its bucket-index handling before locating the affected Java classes and tests. Done means bucket index works during bootstrap, with coverage for that path.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.