confluentinc / confluentinc/parallel-consumer

Provide option for max retires, and a call back when reached (potential DLQ)

Open
#196 5 comments 4 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
299
Forks
172
PR merge metrics
No merged PRs in 30d

Description

Atm, user has to implement the max retry functionality themselves, as documented here: [retries docs branch](https://github.com/confluentinc/parallel-consumer/tree/retry-docs#retries)

This should be part of the system, as an option for a max retry count. When the count is reached, a callback should be executed, providing the user the WorkContainer and the chance to do something with it - maybe produce it do a different topic (DLQ) or simply log it.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the retries documentation branch linked in the issue and trace the existing user-implemented retry flow around WorkContainer. Define how the max retry option and callback should interact, including the information passed when the limit is reached and how a caller could handle a DLQ or logging action. Done means the behavior and callback contract are implemented and covered by tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.