apache / apache/pinot

Kafka ingestion: Allow users to reset the offset to consume

Open
#6,637 7 comments 0 reactions 0 assignees View on GitHub
feature help wanted kafka user-experience
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

This can help users to skip the bad data due to upstream issues.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the Kafka ingestion path and how consumer offsets are configured or persisted. Define how users request an offset reset and how the behavior skips bad upstream data; done means the reset is usable and its expected behavior is covered by the relevant ingestion tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
data-engineering, stream-processing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.