apache / apache/fluss

add support of offset lag

Open
#3,349 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

Now we already have the timestamp lag in flink connector, but it's necessary to have offset lag especially for the long-term backfill

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [x] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the Flink connector's existing timestamp-lag support and trace how lag is configured and applied. Define the corresponding offset-lag behavior for long-term backfills, then add coverage showing that records are selected using an offset lag and that the connector's existing timestamp-lag behavior remains intact.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.