apache / apache/paimon

[Feature] CDC Ingestion should support -U and +U messages

Open
#4,572 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Motivation

I want that reading -U and +U messages from audit log table of paimon table with input changelog producer, but paimon CDC parser does not produce -U and +U messages.

### Solution

I suggest paimon CDC parser produce -U and +U messages for the downstream tasks.

### Anything else?

_No response_

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the Paimon CDC parser and the audit log table handling described in the issue, then trace how changelog messages reach downstream tasks. Confirm the current behavior for -U and +U messages and define completion as producing both message types for CDC input without breaking existing changelog handling.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.