An event was sent twice down `/sync` (and down application service txns?) consistently across clients; ghost notifications

Open

#14,539 opened on Dec 20, 2023 3 comments 1 reaction 0 assignees View on GitHub

A-Sync O-Occasional S-Minor T-Defect

Dominant language: Python
Stars: 4.6k
Forks: 600
Avg merge: 5d 22h
Merged PRs (30d): 51

Description

This issue has been migrated from [#14539](https://github.com/matrix-org/synapse/issues/14539).

---

### Description

### Ghost notifications
Since synapse v1.70 or v1.71, I've noticed randomly occurring "ghost notification", happening on element-web, element-desktop and element-android, hydrogen. They usually come in small, fast bursts of two to four notifications (I hear an audible sound telling me about new events in a room). When I check for new events, there aren't any. Nothing has changed. I have the options `Developer mode` and `Show hidden events in timeline` enabled in element, so I would assume, I'd see any changes to a room.

### Event duplication
Around the same Time, I've noticed some events, some from weeks or months ago, from being randomly duplicated and pushed as new ones. This happens independently of the "ghost notification issue". At first, I've only noticed this in one particular room, where the same messages were duplicated a few times over a couple of days (Example: see "Image 1" below), possibly leading to an unstable room (see "Possible implications). Today, the same thing happened in our mjolnir control room, where mjolnir (configured as a client and not as an appservice) executed the duplicated command (Example: see "Image 2" below). Actually, I'm actually not certain, if my homeserver is the one, the issues originate from, as the duplicated events are visible on other instances too, including `matrix.org` and maybe others as well.

#### Image 1: Duplicated messages in the python room
![event_duplicated_python_room](https://user-images.githubusercontent.com/4131336/203591050-b4451bbd-a026-4e0e-98ce-925ebe31638a.png)

#### Image 2: Mjolnir bot reacts to duplicated events
The "failed to leave" error from mjolnir is unrelated (and already fixed). The duplication errors happened before the room, it was trying to leave, had issues, too, and might have led to the issue, where the room was becoming unstable on my homeserver.
![event_duplicated_mjolnir](https://user-images.githubusercontent.com/4131336/203590750-6c0e8899-13d0-437e-98b9-ab82186c13b2.png)

### Possible implications
After this happened a few times, in the Python room `#python:matrix.org`, the room became unstable on my end, and I was unable to send events to that room any more because of missing state events. I also wasn't able to remove the room with the admin API, so, I manually had to remove the room from the database to gain access again:

```sql
BEGIN; SET CONSTRAINTS ALL DEFERRED;

DELETE FROM appservice_room_list WHERE room_id = '!roomid:matrix.org';
DELETE FROM batch_events WHERE room_id = '!roomid:matrix.org';
DELETE FROM current_state_events WHERE room_id = '!roomid:matrix.org';
DELETE FROM blocked_rooms WHERE room_id = '!roomid:matrix.org';
DELETE FROM current_state_delta_stream WHERE room_id = '!roomid:matrix.org';
DELETE FROM destination_rooms WHERE room_id = '!roomid:matrix.org';
DELETE FROM device_lists_changes_in_room WHERE room_id = '!roomid:matrix.org';
DELETE FROM e2e_room_keys WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_auth_chain_to_calculate WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_auth WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_backward_extremities WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_failed_pull_attempts WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_json WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_forward_extremities WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_edges WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_labels WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_push_actions WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_push_summary WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_reports WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_search WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_txn_id WHERE room_id = '!roomid:matrix.org';
DELETE FROM event_edges WHERE event_id IN (SELECT event_id FROM events WHERE room_id='!roomid:matrix.org');
DELETE FROM event_auth_chains WHERE event_id IN (SELECT event_id FROM events WHERE room_id = '!roomid:matrix.org');
DELETE FROM event_relations WHERE event_id IN (SELECT event_id FROM events WHERE room_id = '!roomid:matrix.org');
DELETE FROM events WHERE room_id = '!roomid:matrix.org';
DELETE FROM federation_inbound_events_staging WHERE room_id = '!roomid:matrix.org';
DELETE FROM insertion_event_edges WHERE room_id = '!roomid:matrix.org';
DELETE FROM insertion_event_extremities WHERE room_id = '!roomid:matrix.org';
DELETE FROM insertion_events WHERE room_id = '!roomid:matrix.org';
DELETE FROM local_current_membership WHERE room_id = '!roomid:matrix.org';
DELETE FROM partial_state_events WHERE room_id = '!roomid:matrix.org';
DELETE FROM partial_state_rooms_servers WHERE room_id = '!roomid:matrix.org';
DELETE FROM pusher_throttle WHERE room_id = '!roomid:matrix.org';
DELETE FROM receipts_linearized WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_account_data WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_aliases WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_depth WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_memberships WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_retention WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_stats_current WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_stats_earliest_token WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_stats_state WHERE room_id = '!roomid:matrix.org';
DELETE FROM state_groups_state WHERE room_id = '!roomid:matrix.org';
DELETE FROM rooms WHERE room_id = '!roomid:matrix.org';
DELETE FROM user_directory WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_tags WHERE room_id = '!roomid:matrix.org';
DELETE FROM room_tags_revisions WHERE room_id = '!roomid:matrix.org';
DELETE FROM state_groups WHERE room_id = '!roomid:matrix.org';
DELETE FROM state_events WHERE room_id = '!roomid:matrix.org';
DELETE FROM users_in_public_rooms WHERE room_id = '!roomid:matrix.org';
DELETE FROM users_who_share_private_rooms WHERE room_id = '!roomid:matrix.org';
DELETE FROM stream_ordering_to_exterm WHERE room_id = '!roomid:matrix.org';
DELETE FROM receipts_graph WHERE room_id = '!roomid:matrix.org';
DELETE FROM threads WHERE room_id = '!roomid:matrix.org';
DELETE FROM partial_state_rooms WHERE room_id = '!roomid:matrix.org';
COMMIT;

REINDEX (verbose) database synapse;
REINDEX (verbose) system synapse;
VACUUM FULL VERBOSE ANALYZE;
```

(Because I had to roll back a few times, while I was trying to figure out, how I can remove the room, I accidentally deleted the logs as well.)

### Steps to reproduce

- Do nothing
- Duplications / ghost events occur

### Homeserver

matrix.org; michaelsasser.org

### Synapse Version

matrixdotorg/synapse; tags: v1.71.0, v1.72.0, possibly v1.70.0

### Installation Method

Docker (matrixdotorg/synapse)

### Database

postgres:15.0-alpine on same machine, It was recently restored to upgrade to v15, not sure, if it happeded before; recently restored while trying to removing room, issues happened before

### Workers

Multiple workers

### Platform

Environment: CX31 [Hetzner Cloud](https://www.hetzner.com/cloud)
Using the Ansible playbook: [spantaleev/matrix-docker-ansible-deploy](https://github.com/spantaleev/matrix-docker-ansible-deploy)
Debian: Linux matrix 5.10.0-19-amd64 vector-im/element-web#1 SMP Debian 5.10.149-2 (2022-10-21) x86_64 GNU/Linux
Docker: Docker version 20.10.21, build baeda1f
Containerd: containerd containerd.io 1.6.10 770bd0108c32f3fb5c73ae1264f7e503fe7b2661

### Configuration

## Playbook

Using the Ansible playbook: [spantaleev/matrix-docker-ansible-deploy], contains multiple files (result below):

Playbook/config

```yaml
---
# hookshot
matrix_hookshot_enabled: true # default
matrix_hookshot_gitlab_enabled: true
matrix_hookshot_permissions:
# Allow all users to send commands to existing services
- actor: "*"
services:
- service: gitlab
level: commands
# Allow users on this domain to log in to gitlab.
- actor: "!foo:michaelsasser.org"
services:
- service: gitlab
level: login
# Allow this specific user to do any action
- actor: "@foo:michaelsasser.org"
services:
- service: "*"
level: admin
---
# Mjolnir
matrix_bot_mjolnir_enabled: true
matrix_bot_mjolnir_access_token: "foo"
matrix_bot_mjolnir_management_room: "!foo:michaelsasser.org"
matrix_bot_mjolnir_configuration_extension_yaml: |
backgroundDelayMS: 50
fasterMembershipChecks: true
recordIgnoredInvites: true
commands:
additionalPrefixes:
- mjolnir
- bot
automaticallyRedactForReasons:
- spam
- advertising
- advertisement
- ad
- scam
protections:
wordlist:
words:
- foo
- more foo
minutesBeforeTrusting: 1234 # 1234 is not the actual time
---
# ssl

matrix_ssl_lets_encrypt_support_email: foo@MichaelSasser.org
---
# element

# set integration manager
matrix_client_element_integrations_ui_url: "https://scalar.vector.im/"
matrix_client_element_integrations_rest_url: "https://scalar.vector.im/api"
matrix_client_element_integrations_widgets_urls:
["https://scalar.vector.im/api"]

# set server room directory
matrix_client_element_roomdir_servers:
- michaelsasser.org
- matrix.org

# Extra themes
matrix_client_element_themes_enabled: false

# Default Template
matrix_client_element_default_theme: "dark"

matrix_client_element_configuration_extension_json: |
{
"sso_redirect_options": {
"immediate": true
}
}

---
# hydrogen
#
matrix_client_hydrogen_enabled: true
---

matrix_grafana_enabled: true
matrix_grafana_anonymous_access: false
matrix_grafana_default_admin_user: foo # Do not change
matrix_grafana_default_admin_password: foo

matrix_grafana_container_extra_arguments:
- -e GF_AUTH_GENERIC_OAUTH_NAME="Single Sign-On"
- -e GF_AUTH_GENERIC_OAUTH_ENABLED="true"
- -e GF_AUTH_GENERIC_OAUTH_CLIENT_ID="matrix-grafana"
- -e GF_AUTH_GENERIC_OAUTH_CLIENT_SECRET="foo"
- -e GF_AUTH_GENERIC_OAUTH_SCOPES="openid"
- -e GF_AUTH_GENERIC_OAUTH_AUTH_URL="https://foo.michaelsasser.org/realms/MichaelSasser/protocol/openid-connect/auth"
- -e GF_AUTH_GENERIC_OAUTH_TOKEN_URL="https://foo.michaelsasser.org/realms/MichaelSasser/protocol/openid-connect/token"
- -e GF_AUTH_GENERIC_OAUTH_API_URL="https://foo.michaelsasser.org/realms/MichaelSasser/protocol/openid-connect/userinfo"
- -e GF_AUTH_GENERIC_OAUTH_ALLOW_SIGN_UP="true"
- -e GF_AUTH_GENERIC_OAUTH_ROLE_ATTRIBUTE_PATH="contains(roles[*], 'Admin') && 'Admin' || contains(roles[*], 'Editor') && 'Editor' || contains(roles[*], 'Viewer') && 'Viewer'|| ''"
- -e GF_AUTH_GENERIC_OAUTH_ROLE_ATTRIBUTE_STRICT="true"
# Disable Login Form
- -e GF_AUTH_DISABLE_LOGIN_FORM="true"
- -e GF_AUTH_OAUTH_AUTO_LOGIN="true"
- -e GF_AUTH_BASIC_ENABLED="false"
---
# email

matrix_mailer_sender_address: "foo@MichaelSasser.org"
matrix_mailer_relay_use: true
matrix_mailer_relay_host_name: "foo.michaelsasser.org"
matrix_mailer_relay_host_port: 587
matrix_mailer_relay_auth: true
matrix_mailer_relay_auth_username: "foo@michaelsasser.org"
matrix_mailer_relay_auth_password: "foo"
---

matrix_synapse_rust_synapse_compress_state_find_rooms_command_wait_time: 1200
matrix_synapse_rust_synapse_compress_state_compress_room_time: 68400
matrix_synapse_rust_synapse_compress_state_psql_import_time: 68400

# Base Domain Serving
matrix_nginx_proxy_base_domain_serving_enabled: true

matrix_nginx_proxy_connect_timeout: 120
matrix_nginx_proxy_send_timeout: 120
matrix_nginx_proxy_read_timeout: 120
matrix_nginx_send_timeout: 120

# Fix issue where the admin api is not reacheable anymore
matrix_nginx_proxy_proxy_matrix_client_redirect_root_uri_to_domain: ""
matrix_nginx_proxy_proxy_matrix_client_api_forwarded_location_synapse_admin_api_enabled: true
---

matrix_postgres_connection_password: "foo"
matrix_postgres_container_postgres_bind_port: 5432

matrix_postgres_process_extra_arguments:
[
"-c max_connections=120",
"-c shared_buffers=512MB",
"-c effective_cache_size=1536MB",
"-c maintenance_work_mem=128MB",
"-c checkpoint_completion_target=0.9",
"-c wal_buffers=16MB",
"-c default_statistics_target=100",
"-c random_page_cost=1.1",
"-c effective_io_concurrency=200",
"-c work_mem=2184kB",
"-c min_wal_size=1GB",
"-c max_wal_size=4GB",
"-c max_worker_processes=2",
"-c max_parallel_workers_per_gather=1",
"-c max_parallel_workers=2",
"-c max_parallel_maintenance_workers=1"
]

# Postgres Backups

matrix_postgres_backup_enabled: true
matrix_postgres_backup_keep_months: 12
---
# grafana prometheus

matrix_prometheus_enabled: true
matrix_prometheus_node_exporter_enabled: true
matrix_prometheus_postgres_exporter_enabled: false
matrix_prometheus_postgres_exporter_database_username: "matrix_prometheus_postgres_exporter"
matrix_prometheus_postgres_exporter_database_password: "foo"

matrix_prometheus_node_exporter_process_extra_arguments:
- "--collector.disable-defaults"
- "--collector.cpu"
- "--collector.filesystem"
- "--collector.os"
- "--collector.stat"
- "--collector.meminfo"
- "--collector.loadavg"
- "--collector.time"
- "--collector.uname" # Mandatory, otherwide the data vanishes from grafana
---
# synapse

# Federation
matrix_synapse_federation_enabled: true
matrix_synapse_allow_public_rooms_over_federation: true

# Controls whether accessing the server's public rooms directory can be done
# without authentication.
# For private servers, you most likely wish to require authentication,
# unless you know what list of rooms you're publishing to the world and
# explicitly want to do it.
matrix_synapse_allow_public_rooms_without_auth: true

# Matrix cache size (ram) default: 0.5
matrix_synapse_caches_global_factor: 1.5 # 0.5, is default

matrix_synapse_event_cache_size: "100K"

# OpenID (Keycloak) (rest see below in matrix_synapse_configuration_extension_yaml)
matrix_nginx_proxy_proxy_matrix_client_api_forwarded_location_synapse_oidc_api_enabled: true

# Extra Synapse homeserver.yaml config
matrix_synapse_configuration_extension_yaml: |
suppress_key_server_warning: true # defaults to matrix.org

####################
# room complexity
####################
limit_remote_rooms:
enabled: true
complexity: 0.5
complexity_error: "This room is too complex."
admins_can_join: true

####################
# blacklist
####################
ip_range_blacklist:
- "123.123.123.123/32" # foo.xyz
- "123.123.123.123/32" # matrix.foo.com
- "123.123.123.123/32" # matrix.foo.sh
- "123.123.123.123/32" # matrix.foo.net
- "123.123.123.123/32" # matrix.foo.biz (CNAME)

####################
# retention
####################
redaction_retention_period: 30d
retention:
enabled: true
default_policy:
min_lifetime: 4w
max_lifetime: 8w
allowed_lifetime_min: 1d
allowed_lifetime_max: 24w
purge_jobs:
- longest_max_lifetime: 3d
interval: 12h
- shortest_max_lifetime: 3d
interval: 1d

####################
# server notice
####################
server_notices:
system_mxid_localpart: server
system_mxid_display_name: "Server Notices"
system_mxid_avatar_url: "mxc://{{ matrix_domain }}/foo"
room_name: "Server Notices"

####################
# OIDC
####################
oidc_providers:
- idp_id: keycloak
idp_name: "Single Sign-On"
issuer: "https://foo.michaelsasser.org/realms/MichaelSasser"
client_id: "synapse"
client_secret: "foo"
scopes: ["openid", "profile"]
allow_existing_users: true
user_mapping_provider:
config:
localpart_template: "{% raw %}{{ user.preferred_username }}{% endraw %}"
display_name_template: "{% raw %}{{ user.name }}{% endraw %}"

# Media retention
matrix_synapse_media_retention_local_media_lifetime: 8w
matrix_synapse_media_retention_remote_media_lifetime: 1w

# workers
matrix_synapse_workers_enabled: true

matrix_synapse_workers_preset: michaelsasser_org

# https://github.com/matrix-org/synapse/blob/develop/docs/workers.md
matrix_synapse_workers_presets:
michaelsasser_org:
generic_workers_count: 1
pusher_workers_count: 1
federation_sender_workers_count: 1
media_repository_workers_count: 1
appservice_workers_count: 1
user_dir_workers_count: 1
background_workers_count: 1
stream_writer_events_stream_workers_count: 0
stream_writer_typing_stream_workers_count: 0
stream_writer_to_device_stream_workers_count: 0
stream_writer_account_data_stream_workers_count: 0
stream_writer_receipts_stream_workers_count: 0
stream_writer_presence_stream_workers_count: 0

# A secret used to protect access keys issued by the server.
# You can put any string here, but generating a strong one is preferred
# (e.g. `pwgen -s 64 1`).
matrix_synapse_macaroon_secret_key: "foo"
matrix_homeserver_generic_secret_key: "{{ matrix_synapse_macaroon_secret_key }}"
matrix_synapse_max_upload_size_mb: 256

matrix_synapse_auto_join_rooms:
- "#support:{{ matrix_domain }}"
# matrix_synapse_use_presence: true # Disable on high load

# Shared Secret Provider
matrix_synapse_ext_password_provider_shared_secret_auth_enabled: false # disabled to make sure no m.password authentication is available
matrix_synapse_ext_password_provider_shared_secret_auth_m_login_password_support_enabled: false # disabled to make sure no m.password authentication is available
matrix_synapse_ext_password_provider_shared_secret_auth_shared_secret: "foo"
---
devture_timesync_ntpd_package: systemd-timesyncd
devture_timesync_ntpd_service: systemd-timesyncd
# A shared secret (between Coturn and Synapse) used for authentication.
# You can put any string here, but generating a strong one is preferred
# (e.g. `pwgen -s 64 1`).
matrix_coturn_turn_static_auth_secret: "foo"

---

# Enable location sharing
matrix_well_known_matrix_client_configuration_extension_json: |-
{
"org.matrix.msc3488.tile_server": {
"map_style_url": "https://api.maptiler.com/maps/streets/style.json?key=foo"
},
"m.tile_server": {
"map_style_url": "https://api.maptiler.com/maps/streets/style.json?key=foo"
},
"setting_defaults": {
"MessageComposerInput.showStickersButton": false
},
"features": {
"feature_latex_maths": true,
"feature_pinning": true,
"feature_thread": true,
"feature_html_topic": true
},
"admins": [{
"matrix_id": "@foo:michaelsasser.org",
"email_address": "foo@michaelsasser.org",
"role": "admin"
},
{
"email_address": "foo@michaelsasser.org",
"role": "security"
}]
}
```
Results in:

## homeserver.yaml
```yaml
account_threepid_delegates:
msisdn: ''
alias_creation_rules:
- action: allow
alias: '*'
room_id: '*'
user_id: '*'
allow_guest_access: false
allow_public_rooms_over_federation: true
allow_public_rooms_without_auth: true
allowed_avatar_mimetypes:
- image/png
- image/jpeg
- image/gif
app_service_config_files:
- /hookshot-registration.yml
auto_join_rooms:
- '#foo:michaelsasser.org'
autocreate_auto_join_rooms: true
background_updates: null
caches:
global_factor: 1.5
per_cache_factors: null
cas_config: null
daemonize: false
database:
args:
cp_max: 10
cp_min: 5
database: synapse
host: matrix-postgres
password: foo
port: 5432
user: synapse
name: psycopg2
txn_limit: 0
default_room_version: '9'
email:
app_name: Matrix
client_base_url: https://element.michaelsasser.org
enable_notifs: true
invite_client_location: https://app.element.io
notif_for_new_users: true
notif_from: Matrix
require_transport_security: false
smtp_host: matrix-mailer
smtp_port: 8025
enable_media_repo: false
enable_metrics: true
enable_registration: false
enable_registration_captcha: false
enable_registration_without_verification: false
enable_room_list_search: true
encryption_enabled_by_default_for_room_type: 'off'
event_cache_size: 100K
federation_rr_transactions_per_room_per_second: 50
federation_sender_instances:
- matrix-synapse-worker-federation-sender-0
form_secret: foo
include_profile_data_on_invite: true
instance_map: {}
ip_range_blacklist:
- 123.123.123.123/32 # not actually 123...
- 123.123.123.123/32
- 123.123.123.123/32
- 123.123.123.123/32
- 123.123.123.123/32
limit_profile_requests_to_users_who_share_rooms: false
limit_remote_rooms:
admins_can_join: true
complexity: 0.5
complexity_error: This room is too complex.
enabled: true
listeners:
- bind_addresses:
- 0.0.0.0
port: 9100
type: metrics
- bind_addresses:
- '::'
port: 8008
resources:
- compress: false
names:
- client
tls: false
type: http
x_forwarded: true
- bind_addresses:
- '::'
port: 8048
resources:
- compress: false
names:
- federation
tls: false
type: http
x_forwarded: true
- bind_addresses:
- 0.0.0.0
port: 9093
resources:
- names:
- replication
type: http
log_config: /data/matrix.michaelsasser.org.log.config
macaroon_secret_key: foo
manhole_settings: null
max_spider_size: 10M
max_upload_size: 256M
media_instance_running_background_jobs: matrix-synapse-worker-media-repository-0
media_retention:
local_media_lifetime: 8w
remote_media_lifetime: 1w
media_storage_providers: []
media_store_path: /matrix-media-store-parent/media-store
metrics_flags: null
modules: []
notify_appservices_from_worker: matrix-synapse-worker-appservice-0
oembed: null
oidc_providers:
- allow_existing_users: true
client_id: synapse
client_secret: foo
idp_id: keycloak
idp_name: Single Sign-On
issuer: https://foo.michaelsasser.org/realms/MichaelSasser
scopes:
- openid
- profile
user_mapping_provider:
config:
display_name_template: '{{ user.name }}'
localpart_template: '{{ user.preferred_username }}'
old_signing_keys: null
opentracing: null
password_config:
localdb_enabled: false
pepper: ''
policy: null
pid_file: /homeserver.pid
presence:
enabled: true
public_baseurl: https://matrix.michaelsasser.org/
purge_jobs:
- interval: 12h
longest_max_lifetime: 3d
- interval: 1d
shortest_max_lifetime: 3d
push:
include_content: true
pusher_instances:
- matrix-synapse-worker-pusher-0
rc_admin_redaction:
burst_count: 50
per_second: 1
rc_federation:
concurrent: 3
reject_limit: 50
sleep_delay: 500
sleep_limit: 10
window_size: 1000
rc_invites:
per_issuer:
burst_count: 10
per_second: 0.3
per_room:
burst_count: 10
per_second: 0.3
per_user:
burst_count: 5
per_second: 0.003
rc_joins:
local:
burst_count: 10
per_second: 0.1
remote:
burst_count: 10
per_second: 0.01
rc_login:
account:
burst_count: 3
per_second: 0.17
address:
burst_count: 3
per_second: 0.17
failed_attempts:
burst_count: 3
per_second: 0.17
rc_message:
burst_count: 10
per_second: 0.2
rc_registration:
burst_count: 3
per_second: 0.17
recaptcha_private_key: ''
recaptcha_public_key: ''
redaction_retention_period: 30d
redis:
enabled: true
host: matrix-redis
password: null
port: 6379
registration_requires_token: false
registration_shared_secret: foo
report_stats: false
require_auth_for_profile_requests: false
retention:
allowed_lifetime_max: 24w
allowed_lifetime_min: 1d
default_policy:
max_lifetime: 8w
min_lifetime: 4w
enabled: true
room_list_publication_rules:
- action: allow
alias: '*'
room_id: '*'
user_id: '*'
room_prejoin_state: null
run_background_tasks_on: matrix-synapse-worker-background-0
saml2_config:
sp_config: null
user_mapping_provider:
config: null
send_federation: false
server_name: michaelsasser.org
server_notices:
room_name: Server Notices
system_mxid_avatar_url: mxc://michaelsasser.org/foo
system_mxid_display_name: Server Notices
system_mxid_localpart: server
signing_key_path: /data/matrix.michaelsasser.org.signing.key
spam_checker: []
sso: null
start_pushers: false
stats: null
stream_writers: {}
suppress_key_server_warning: true
templates: null
tls_certificate_path: null
tls_private_key_path: null
trusted_key_servers:
- server_name: matrix.org
turn_allow_guests: false
turn_shared_secret: foo
turn_uris:
- turn:matrix.michaelsasser.org?transport=udp
- turn:matrix.michaelsasser.org?transport=tcp
ui_auth: null
update_user_directory_from_worker: matrix-synapse-worker-user-dir-0
url_preview_accept_language:
- en-US
- en
url_preview_enabled: true
url_preview_ip_range_blacklist:
- 127.0.0.0/8
- 10.0.0.0/8
- 172.16.0.0/12
- 192.168.0.0/16
- 100.64.0.0/10
- 192.0.0.0/24
- 169.254.0.0/16
- 192.88.99.0/24
- 198.18.0.0/15
- 192.0.2.0/24
- 198.51.100.0/24
- 203.0.113.0/24
- 224.0.0.0/4
- ::1/128
- fe80::/10
- fc00::/7
- 2001:db8::/32
- ff00::/8
- fec0::/10
user_directory: null
user_ips_max_age: 28d
worker_app: synapse.app.homeserver
```
## Workers

```yaml
# $cat worker.matrix-synapse-worker-*

################################################

worker_app: synapse.app.generic_worker
worker_name: matrix-synapse-worker-appservice-0