linkedin / linkedin/Burrow

burrow lags in generating consumer/topic list

Open
#752 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
4k
Forks
818
Avg merge
1h 14m
Merged PRs (30d)
1

Description

Im facing an issue when trying to get all consumer groups and topics under a kafka cluster through the HTTP endpoints:-
`/v3/kafka/(cluster)/consumer` and `/v3/kafka/(cluster)/consumer/(group)`
Everytime burrow is restarted (using kill -1 and running the process again), the output of the above endpoints will initially display empty lists and then slowly start to update with actual amount of consumers/topics over the period of next 5-10 seconds.

Is this intended behaviour or burrow can get incomplete data from kafka clusters ?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce a restart and poll the `/v3/kafka/(cluster)/consumer` and `/v3/kafka/(cluster)/consumer/(group)` endpoints during the first 10 seconds. Trace how these endpoints populate their consumer and topic lists, then determine whether the delayed update is intended behavior or incomplete Kafka data; document the expected result.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, kafka
Domain
api, stream-processing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.