apache / apache/gravitino

[FEATURE] Support Apache Flink 2.1

Open
#12,640 0 comments 0 reactions 0 assignees View on GitHub
feature
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 16h
Merged PRs (30d)
298

Description

### Describe the feature

Add support for Apache Flink 2.1 to the flink-connector module, alongside the existing 1.18/1.19/1.20 support.

### Motivation

Flink 2.x is a major release with breaking API changes. Users running Flink 2.1 currently have no Gravitino
connector to use.

### Describe the solution

Add a new flink-2.1 connector module supporting Iceberg, Paimon, and JDBC catalogs. Hive catalog is not yet
supported, since flink-connector-hive has no release targeting Flink 2.x yet.

Contributor guide

Open the contributing guide

Research direction

Start in the flink-connector module by comparing the existing Flink 1.18, 1.19, and 1.20 connector modules and their build or test configuration. Check the API changes required for Flink 2.1, then verify support for Iceberg, Paimon, and JDBC catalogs; done means the new Flink 2.1 module builds and its tests pass without adding Hive support.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.