apache / apache/hudi

Revisit metadata table compaction planning

Open
#17,035 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

We need to revisit whether the planner needs to write an instant in the past or if we can plan using the regular patterns we have.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-9477
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-9384

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are named. Start by reviewing the metadata-table compaction planner and the linked JIRA issues HUDI-9477 and HUDI-9384, then determine whether planning an instant in the past is necessary or whether regular patterns suffice. Done means the planning approach and required implementation scope are documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.