JasonLovesDoggo / JasonLovesDoggo/abacus
Streaming does not support multi shards
Open
help wanted
- Dominant language
- Go
- Stars
- 41
- Forks
- 7
- Avg merge
- 41m
- Merged PRs (30d)
- 1
Description
Currently, the streaming impl relies on local channels & maps. We would need to offload the listeners to redis/a pubsub system to scale streaming up
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading the streaming implementation and tracing how its local channels and maps handle listeners. Compare that design with Redis or another pub/sub system for multi-shard operation. Done means streaming listeners can scale across multiple shards without relying only on local state.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, redis
- Domain
- backend, distributed-systems, stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100