Enable Polaris to "catalog" tables based on Apache Flink CDC tables
- Dominant language
- Java
- Stars
- 2.1k
- Forks
- 522
- Avg merge
- 1d 22h
- Merged PRs (30d)
- 137
Description
### Is your feature request related to a problem? Please describe.
_No response_
### Describe the solution you'd like
We need a way to allow the user to create a catalog, type: generic
with catalog type being polaris.
Which then point at a PostgreSQL source table to consume, or mySQL, or Mongo or Kafka or ...
This way if the user closes the session and come back in his CDC sources are all still defined inside a catalog and one or more databases,
### Describe alternatives you've considered
Currently only Hive Metastore allows for storing CDC source tables.
### Additional context
_No response_
Contributor guide
Research direction
The issue names no files, tests, or entry points. Start by mapping Polaris's generic catalog creation and table persistence paths, then clarify which CDC sources must be supported and how completion will be verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- kafka, mongodb, mysql, postgresql
- Domain
- backend, data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100