linkedin / linkedin/Burrow

Option for on-request debugging of a consumer group

Open
#44 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Go
Stars
4k
Forks
818
Avg merge
1h 14m
Merged PRs (30d)
1

Description

While debugging a problem with ZK offset checking, I found it was necessary to have some in-depth debugging of a particular consumer group so I could watch it. I added debug logging for offset commits to the code, but this can be overwhelming to turn on for a busy instance. It would be much nicer to turn on debug logging for a particular group in a particular cluster with a request to the API, and disable it again when done.

This shouldn't be too difficult. We just need to maintain a list of (cluster, group) tuples to emit debug logging for, similar to the group blacklist. It could even be just group (over all clusters) to simplify things. Probably makes sense to add a common debug logging method that encapsulates this logic.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the existing group blacklist and offset-commit debug logging paths, then trace the API entry points for enabling and disabling diagnostics. Done means a request can toggle debug logging for a selected consumer group, with the scope and behavior matching the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, kafka
Domain
api, backend, observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.