apache / apache/fluss

[Umbrella][Flink] Improve Fluss Flink Connector production readiness

Open
#3,721 3 comments 1 reaction 1 assignee Claimed by @loserwang1024 View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
2d 20h
Merged PRs (30d)
119

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

The Fluss Flink Connector has already provided many important capabilities for building real-time analytics and lakehouse pipelines with Flink, including streaming reads, lookup joins, sink writes, changelog consumption, and integration with Fluss tables.

However, there are still several limitations that make it harder to adopt Fluss in production workloads, especially compared with more mature connectors. For example, batch reading is still limited, virtual tables do not yet have the same capabilities as normal tables, lookup joins lack full-cache support, source and lookup metrics are not complete enough for production troubleshooting, and batch DML/write optimizations still need improvement.

This umbrella issue tracks the work planned in this release to improve the completeness, performance, and operability of the Fluss Flink Connector.

After this umbrella issue is completed, the Fluss Flink Connector should be more complete and production-ready for real-time analytics, real-time lakehouse, lookup join, historical replay, and batch maintenance workloads.

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.