confluentinc / confluentinc/parallel-consumer

Seeking to a specific offset for a partition

Open
#782 6 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
299
Forks
172
PR merge metrics
No merged PRs in 30d

Description

The Kafka consumer client has the functionality to seek to a specific offset for a partition--see [Controlling The Consumer's Position](https://kafka.apache.org/0100/javadoc/org/apache/kafka/clients/consumer/KafkaConsumer.html).

The current parallel consumer state does not allow seeking to a specific offset. We're looking to see if it is possible to do add to this library for us to be able to re-read messages if necessary.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Kafka Consumer documentation linked in the issue, especially the position and seek behavior, then inspect how the current parallel consumer represents partition state. Define what API and state changes are needed to seek and re-read messages, and verify the expected behavior against Kafka's consumer semantics.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
distributed-systems, stream-processing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.