apache / apache/paimon-webui

[Feature] Enhance the data lake ingestion experience and management.

Open
#524 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
147
Forks
63
PR merge metrics
No merged PRs in 30d

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/paimon-webui/issues) and found nothing similar.

### Motivation

Support near real-time data ingestion from any data source and manage the data ingestion jobs.

1. Job editing, drag and drop source, transform, router, and sink nodes, edit configuration information, which includes single table to single table synchronization, multiple tables to single table (sharding by database and table) synchronization, multiple tables to multiple tables (entire database) synchronization, schema evolution, and data traffic control.

2. Job operation, job start by specifying start positions (earliest, latest, specified time, specified position, full synchronization, incremental synchronization, full + incremental synchronization), job stop, and job reset.

### Solution

Integration with Flink CDC 3.x.

### Anything else?

_No response_

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.