apache / apache/hudi

Simplify TimeTravel logic for Spark

Open
#15,304 1 comment 0 reactions 1 assignee Claimed by @KnightChess View on GitHub
from-jira priority:high status:pr-available type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Existing Hudi relies on .g4 files and antlr classes to make time travel work for Spark 3.2 

As time travel is supported on Spark 3.3. Those logic can be greatly simplified and some of them can also be removed

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-4468
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-4186
- Fix version(s):
- 1.1.0

---

## Comments

17/Nov/24 07:49;knightchess;to facilitate the implementation of a multi-lake architecture, I will drive the rollout of this improvement. [~alexey.kudinkin] ;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.