spring-cloud / spring-cloud/spring-cloud-stream
Multiple partition support per Sink instance
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 1.1k
- Forks
- 646
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 8
Description
@tajdars commented on Wed Feb 21 2018
Moved from
https://github.com/spring-cloud/spring-cloud-stream/issues/1232
I've a RabbitMQ binder based Stream Sink Service with parent set to :
org.springframework.cloud
spring-cloud-build
1.3.7.RELEASE
The input Topic is partitioned,
How can we get more than 1 Topic partition assigned to a Sink Service instance ?
Basically we want to limit the # of Sink Service instances but still get the parallelism across partitions.
Thanx,
@olegz commented on Wed Feb 21 2018
@tajdars Thank you for moving it! As I mentioned we'd be definitely interested in contribution from the community so if you up for the challenge go ahead and give it a shot and submit a PR and we'll work with you to make it happen.
Thanks again!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source file or test is named. Start by tracing how the RabbitMQ binder assigns partitions to a Sink service instance; done means one Sink instance can receive more than one input partition while preserving parallelism with fewer instances.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, rabbitmq, spring
- Domain
- backend, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100