apache / apache/auron

Auron Flink native operator support watermark

Open
#2,315 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
1.8k
Forks
241
Avg merge
2d 14h
Merged PRs (30d)
22

Description

We've added support for Flink's Watermark mechanism in the Kafka Source. As more and more operators get native support, we plan to merge connected native operators together for execution to reduce the R2C (row-to-columnar) conversion overhead. However, Auron's current Watermark mechanism isn't designed for this scenario, so we need to design a solution that fits this use case while still satisfying the Watermark constraints.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.