element-hq / element-hq/synapse

Reduce Redis traffic between workers.

Open
#12,463 0 comments 0 reactions 0 assignees View on GitHub
A-Workers T-Task
Dominant language
Python
Stars
4.6k
Forks
600
Avg merge
5d 22h
Merged PRs (30d)
51

Description

This issue has been migrated from [#12463](https://github.com/matrix-org/synapse/issues/12463).

---

On matrix.org or we're seeing a *lot* of traffic going over our VPNs, most of which is Redis related. We should try and reduce this a bit.

Some things that would help, in order of effort:

- [x] https://github.com/matrix-org/synapse/issues/12462 ─ This would allow connecting directly rather than over the VPN.
- [x] https://github.com/matrix-org/synapse/issues/12460
- [ ] https://github.com/matrix-org/synapse/issues/12461

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked issue #12461, since it is the only remaining unchecked item. Compare it with the completed work in #12462 and #12460, then identify how the change can reduce Redis traffic between workers. Done means the remaining traffic-reduction work is implemented and its effect can be verified against the reported VPN traffic problem.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, redis
Domain
backend, distributed-systems, performance
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.