apache / apache/gravitino

[FEATURE] Support AWS Glue catalog in the Flink connector

Open
#12,450 2 comments 0 reactions 1 assignee Claimed by @xxubai View on GitHub
2.0.0 feature
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 16h
Merged PRs (30d)
298

Description

### Describe the feature

Add AWS Glue Data Catalog support to the Gravitino Flink connector. Currently, a Gravitino catalog with `provider=glue` cannot be loaded because no corresponding Flink catalog factory is registered.

The connector should support Hive-compatible and Iceberg tables stored in Glue.

### Motivation

Gravitino already supports Glue on the server side and through the Spark and Trino connectors. Adding Flink support completes the query-engine integration and enables Flink users to access Glue-managed tables through Gravitino.

### Describe the solution

Add a `GravitinoGlueCatalogFactory` and a `GravitinoGlueCatalog` that:

- Route Hive-compatible tables through the existing Flink Hive catalog path.
- Route Iceberg tables through the Iceberg `FlinkCatalog` backed by `GlueCatalog`.
- Map Glue catalog properties and support Gravitino credential vending.
- Provide tests for supported Flink versions.

### Additional context

The proposed design is described in:

https://github.com/apache/gravitino/blob/main/design-docs/gravitino-glue-catalog.md#63-flink

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.