apache / apache/hudi

Treat full bootstrap table as regular table

Open
#15,974 0 comments 0 reactions 0 assignees View on GitHub
component:bootstrap from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Bootstrap tables have a performance hit compared to regular tables. If you bootstrap with full bootstrap mode, I think we should just treat the table like a regular table. I think the easiest way to do this would be to prevent setting bootstrap base path in the tableconfig. If that isn't possible, then we could add another table config stating if it has metadata only bootstrap files.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6253
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Start by locating the full-bootstrap table configuration and the code that applies its bootstrap base path, then determine how regular-table behavior is verified. Done means full-bootstrap tables avoid the regular-table performance hit without breaking metadata-only bootstrap behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.