apache / apache/hudi

Add support for snapshot management, tagging etc

Open
#15,190 0 comments 0 reactions 0 assignees View on GitHub
from-jira priority:high type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Ref: [https://github.com/apache/hudi/issues/5146]

Add support for named snapshots, adding tags for easier managability of snapshots. 
* snapshot:
** take a snapshot of the table with say "2022_S2_stable_sales" as snapshot name. Later queries should be feasible for a given snapshot. may be we can think of optimzing the layout when such snapshots are taken. (for eg, compacted, clustered etc)
* tagging:
** Should be able to add tags to an existing snapshot for easier search and retrieval of snapshots. 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-4092
- Type: New Feature

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the linked GitHub issue #5146 and JIRA ticket HUDI-4092 to understand the intended snapshot and tagging design. Then locate Hudi's existing snapshot and table-query entry points; the work is complete when named snapshots can be queried later and tags can be added, searched, and used to retrieve existing snapshots.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.