apache / apache/hudi

Async cleaning with metadata table

Open
#14,867 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:blocker type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

As of now, we do inline cleaning for metadata table. we should relax this constraint and support async. 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-2460
- Type: Task
- Epic: https://issues.apache.org/jira/browse/HUDI-1292

Contributor guide

No contributing guide indexed for this repository

Research direction

No source files, tests, or entry points are named in the issue. Start by reviewing the linked JIRA issues HUDI-2460 and HUDI-1292 and the existing inline metadata-table cleaning behavior; done means metadata-table cleaning supports asynchronous execution.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.