opensearch-project / opensearch-project/data-prepper
Use KafkaCustomConsumerFactory in configuring consumer in KafkaSource
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 374
- Forks
- 354
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Is your feature request related to a problem? Please describe.
There have been duplication of code between KafkaSource and KafkaCustomConsumerFactory which are doing similar things with subtle difference
Describe the solution you'd like
Refactoring out the duplication of code
Describe alternatives you've considered (Optional)
N/A
Additional context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating and reading KafkaSource and KafkaCustomConsumerFactory, then compare how each configures consumers and identify the duplicated behavior. Refactor the shared configuration so KafkaSource uses KafkaCustomConsumerFactory, preserving the existing subtle differences and consumer behavior. Done means the duplication is removed without changing the source's expected behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, kafka
- Domain
- stream-processing
- Issue type
- Refactor
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100