apache / apache/hudi

Support sink multiple tables with schema evolution into Hudi

Open
#14,924 1 comment 0 reactions 1 assignee Claimed by @cshuo View on GitHub
engine:flink priority:high type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

We have hundreds of OLTP tables that need to be synchronized to Hudi data Lake in real time. If we launch a synchronization job per table, resources and management will be a big challenge. Therefore, we eagerly looking for a FULL database synchronization tool, which can synchronize multiple tables to Hudi data lake in one job. At the same time, it is better to support schema evolution, because OLTP tables often modify the schema of tables.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-2993
- Type: New Feature

---

## Comments

31/Jan/22 17:08;shivnarayan;CC [~xiaotaotao] [~vbalaji]  [~codope] ;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.