[Feature] Introduce Data Evolution MergeInto procedure for Flink
- Dominant language
- Java
- Stars
- 3.4k
- Forks
- 1.4k
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 396
Description
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Motivation
As current org.apache.paimon.flink.procedure.MergeIntoProcedure implementation, we could also introduce a DataEvolution MergeInto Action and Procedure, to support light-weight column append and update in Flink.
### Solution
Follow spark's MergeIntoPaimonDataEvolutionTable implementation.
### Anything else?
_No response_
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading the existing org.apache.paimon.flink.procedure.MergeIntoProcedure implementation and Spark's MergeIntoPaimonDataEvolutionTable implementation. Use those entry points to determine the corresponding Flink DataEvolution action and procedure, with support for lightweight column append and update as the completion criteria.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, stream-processing
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100