knative-extensions / knative-extensions/func-go
Kafka middleware: concurrency control
- Dominant language
- Go
- Stars
- 7
- Forks
- 12
- PR merge metrics
- No merged PRs in 30d
Description
Add configurable parallelism — e.g. process N messages concurrently per partition, or across partitions. Currently messages are processed one at a time, sequentially per partition.
Related: #177 (batch processing — both address throughput, design choices overlap).
Contributor guide
Research direction
Start at the Kafka middleware entry point and trace how messages are currently processed sequentially within partitions. Read related issue #177 to compare the overlapping throughput and design concerns. Done means a documented, configurable concurrency model that processes messages in parallel while preserving the required partition behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, kafka
- Domain
- stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100