apache / apache/rocketmq

[Enhancement]Add deduplication for message consumers

Open
#10,263 0 comments 0 reactions 0 assignees View on GitHub
type/enhancement
Dominant language
Java
Stars
22.6k
Forks
12k
Avg merge
2d 20h
Merged PRs (30d)
26

Description

### Before Creating the Enhancement Request

- [x] I have confirmed that this should be classified as an enhancement rather than a bug/feature.

### Summary

Add deduplication for message consumers.

### Motivation

At-least-once delivery may lead to duplicate processing.

### Describe the Solution You'd Like

Add message_id
Maintain processed ID set
Skip duplicates

### Describe Alternatives You've Considered

Accept duplicates (risk inconsistent state)

### Additional Context

_No response_

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by locating the Java message-consumer implementation and its message identity handling; define how message_id values are supplied and retained, then verify that repeated deliveries are skipped while new messages are processed.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.