apache / apache/polaris

Enable Polaris to "catalog" tables based on Apache Flink CDC tables

Open
#3,289 6 comments 0 reactions 0 assignees View on GitHub
enhancement stale
Dominant language
Java
Stars
2.1k
Forks
522
Avg merge
1d 22h
Merged PRs (30d)
137

Description

### Is your feature request related to a problem? Please describe.

_No response_

### Describe the solution you'd like

We need a way to allow the user to create a catalog, type: generic
with catalog type being polaris.
Which then point at a PostgreSQL source table to consume, or mySQL, or Mongo or Kafka or ...
This way if the user closes the session and come back in his CDC sources are all still defined inside a catalog and one or more databases,

### Describe alternatives you've considered

Currently only Hive Metastore allows for storing CDC source tables.

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by mapping Polaris's generic catalog creation and table persistence paths, then clarify which CDC sources must be supported and how completion will be verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka, mongodb, mysql, postgresql
Domain
backend, data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.