element-hq / element-hq/synapse

Remove the need for `worker_name` to simplify scaling

Open
#8,084 0 comments 1 reaction 0 assignees View on GitHub
A-Workers T-Enhancement z-p3
Dominant language
Python
Stars
4.6k
Forks
600
Avg merge
5d 22h
Merged PRs (30d)
51

Description

This issue has been migrated from [#8084](https://github.com/matrix-org/synapse/issues/8084).

---

**Description:**

The recent-ish changes to workers now recommend to set a unique `worker_name` per worker process. This makes scaling the number of workers quite a bit more complex than previously since now every instance needs a tailor made config file.

This is especially annoying when using things like docker-compose, swarm or kubernetes where spinning up multiple (identical) instances of a service is a built-in feature.

I have no concrete proposal on how to solve the problem(s) the worker name solves though. (AFAICS they're only really necessary for reverse mapping for federation senders and stream writers?)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.