apache / apache/hudi

The pending table service operation should check whether the partition corresponding to the filegroup exists

Open
#15,738 0 comments 0 reactions 0 assignees View on GitHub
area:table-service from-jira priority:medium type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

At present,  DeletePartitionCommitActionExecutor prevents the partition from being dropped when there is pending table service operation. The pending table service should check whether the partition corresponding to the filegroup exists, not block the execution of DDL operation.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-5663
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with DeletePartitionCommitActionExecutor and trace how pending table service operations are checked during partition deletion. Verify the behavior against the filegroup's corresponding partition: DDL should proceed when that partition does not exist, while the existing protection should remain when it does.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.