apache / apache/rocketmq-flink
[BUG] some bug in newSource
- Dominant language
- Java
- Stars
- 174
- Forks
- 104
- PR merge metrics
- No merged PRs in 30d
Description
1.InnerConsumerImpl ，set OffsetsSelector.committedOffsets(),if offset=-1, and minoffset >-1
set offset will thorw exception
2.RocketMQSourceEnumerator
a. this.pendingSplitAssignmentMap not remove ,when taskmanager restart , it will resend taskmanager and reset offset
,Repeated consumption
b. addSplitsBack(List splits, int subtaskId),splits not handle
3.RocketMQSourceEnumStateSerializer deserializeMessageQueue bug
4.RocketMQSplitReader
when wakeup Shouldn't pause Consumer，Will lead to no consumption
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the named components: InnerConsumerImpl, RocketMQSourceEnumerator, RocketMQSourceEnumStateSerializer, and RocketMQSplitReader. Reproduce the offset=-1, task-manager restart, split-return, deserialization, and wakeup cases described in the issue. Done means each reported case has a verified correction without repeated consumption or paused consumption.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- distributed-systems, stream-processing
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100