apache / apache/gravitino

[EPIC] Implement retention-driven purge for IRC tables

Open
#12,397 0 comments 0 reactions 1 assignee Claimed by @nevzheng View on GitHub
epic
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 15h
Merged PRs (30d)
315

Description

### Describe the proposal

Implement the accepted handoff from an expired retained deletion to asynchronous physical Iceberg purge. The implementation must safely select eligible records, claim work, preserve the lifecycle boundary during worker retries, and reuse existing hard-delete mechanics where the approved design permits.

### Task list

- [ ] Implement expiry selection and purge-work claiming.
- [ ] Integrate the approved handoff with cleanup execution.
- [ ] Implement restart, retry, and multi-replica safety behavior.
- [ ] Add operational logging, metrics, and guidance.
- [ ] Add end-to-end expiry and purge-race coverage.

Depends on: #12393, #12394, #12395

Related to: #12392, `design-docs/async-iceberg-rest-hard-deletion.md`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.