apache / apache/rocketmq-externals

[rocketmq-replicator] Realize consumption offset synchronization

Open
#844 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
4.6k
Forks
3k
Avg merge
2h 33m
Merged PRs (30d)
1

Description

1. Please describe the feature you are requesting.
- Provide MetaSinkTask, call MetaSinkTask in WorkerDirectTask to write data directly to the target cluster.
- In MetaSinkTask, the updateConsumeOffset method will be called to update the target cluster consumeOffset.

2. Provide any additional detail on your proposed use case for this feature.
- #824

3. Indicate the importance of this issue to you (blocker, must-have, should-have, nice-to-have). Are you currently using any workarounds to address this issue?
- should-have

4. If there are some sub-tasks using -[] for each subtask and create a corresponding issue to map to the sub task:
- Maintain BrokerName mapping(ISSUE has not been submitted)
- Maintain the ConsumeOffset deviation between the target cluster and the source cluster(ISSUE has not been submitted)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the rocketmq-replicator implementation around MetaSinkTask and WorkerDirectTask, then review issue #824 for context. Trace how updateConsumeOffset is currently expected to update the target cluster and determine how BrokerName mapping and ConsumeOffset deviation handling fit the requested synchronization. Done means the target cluster's consumption offset is updated through MetaSinkTask when invoked by WorkerDirectTask.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.