matrix-org/complement

View on GitHub

Matrix compliance test suite

Stars: 99
Forks: 72
Open beginner issues: 0
Indexed issues: 44
Avg merge: 4d 1h
Merged PRs (30d): 8

Dominant language: Go
License: Apache-2.0
Last GitHub push: Sep 16, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

44 open issues indexed

`TestRoomCreationReportsEventsToMyself` tests unspecified behaviour Open

Difficulty 3/5 1-2 days Newbie friendliness 52/100

matrix-org/complement#901 · 1 comment · Opened Jul 15, 2026
`TestRoomDeleteAlias` tests optional behaviour but fails if it is not performed Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

matrix-org/complement#900 · 1 comment · Opened Jul 15, 2026
Device deletion tests depend on oneshot UIA Open

Difficulty 3/5 1-2 days Newbie friendliness 55/100

matrix-org/complement#899 · Opened Jul 15, 2026
Account deactivation tests depend on oneshot UIA Open

Difficulty 3/5 1-2 days Newbie friendliness 56/100

matrix-org/complement#898 · Opened Jul 15, 2026
Password change tests depend on oneshot UIA Open

Difficulty 3/5 1-2 days Newbie friendliness 62/100

matrix-org/complement#897 · Opened Jul 15, 2026
About Ms3930 check conditions kind Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matrix-org/complement#824 · Opened Dec 3, 2025
`gotestfmt` can mask errors: "BUG: Empty package name encountered." Open

good first issue help wanted

Difficulty 4/5 3-5 days Newbie friendliness 48/100

matrix-org/complement#821 · 1 comment · Opened Nov 20, 2025
Test failures when v12 rooms are the default Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#799 · 1 comment · Opened Sep 1, 2025
TestOutboundFederationIgnoresMissingEventWithBadJSONForRoomVersion6 causes other tests to be flaky Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#751 · Opened Dec 19, 2024
Homerunner network creation seems to race deployment Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#720 · 1 comment · Opened Apr 11, 2024
Add CI for running Complement in Podman Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

matrix-org/complement#715 · 2 comments · Opened Feb 27, 2024
Change how server logs are dumped Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

matrix-org/complement#708 · Opened Feb 14, 2024
Content-Type check is too restrictive in "TestRegistration/parallel/POST_{}_returns_a_set_of_flows" Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

matrix-org/complement#696 · 1 comment · Opened Dec 4, 2023
Enable application service registration files to be fully editable Open

app-service

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#680 · Opened Oct 18, 2023
Test configuration options Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

matrix-org/complement#678 · Opened Oct 17, 2023
Smoke testing core features Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#660 · 1 comment · Opened Oct 4, 2023
Container feature detection Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#656 · 1 comment · Opened Oct 2, 2023
Simplify internals Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#655 · 3 comments · 1 reaction · Opened Oct 2, 2023
Refactor how skipped tests are defined Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#654 · 7 comments · Opened Oct 2, 2023
`TestFederatedEventRelationships` seems flakey Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matrix-org/complement#595 · Opened Feb 1, 2023
`TestEventRelationships` seems flakey Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

matrix-org/complement#594 · Opened Feb 1, 2023
De-emphasise and reduce the usage of `/_synapse` endpoints Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#544 · 1 comment · Opened Oct 29, 2022
Test unit length compliance (255 bytes vs unicode points) Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

matrix-org/complement#531 · 1 comment · Opened Oct 21, 2022
`TestSendAndFetchMessage` marked as "Flakey" on Dendrite Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#518 · Opened Oct 16, 2022
Two key-upload-related tests being blacklisted by synapse Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

matrix-org/complement#517 · Opened Oct 16, 2022
Add ability for dendrite to read AS registration files from blueprint Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

matrix-org/complement#514 · 1 comment · Opened Oct 16, 2022
container logs not flushed if there is a timeout spinning up a container Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matrix-org/complement#484 · 1 comment · Opened Sep 29, 2022
Suspected flake: `sync_should_succeed_even_if_the_sync_token_points_to_a_redaction_of_an_unknown_event` Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matrix-org/complement#461 · Opened Sep 14, 2022
Homerunner /create intermittently fails with "failed to create deployment: CreateDeployment: Deploy returned error" Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#400 · 1 comment · Opened Jun 30, 2022
Test relations (MSC2675) and threads (MSC3440, et al) Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#351 · 1 comment · Opened Mar 24, 2022
Specify what matrix version complement is testing Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

matrix-org/complement#335 · 2 comments · Opened Mar 7, 2022
Swap out golangci-lint GHA for manual one Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

matrix-org/complement#290 · 1 comment · Opened Jan 21, 2022
Test global profile compliance Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#284 · 1 comment · Opened Jan 8, 2022
Disambiguate blueprints by hash instead of name Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#273 · 1 comment · Opened Dec 10, 2021
sytest "Can delete canonical alias" is enforcing "MAY" wording in the spec as mandatory Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matrix-org/complement#265 · Opened Dec 2, 2021
Pusher infrastructure Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

matrix-org/complement#264 · Opened Dec 2, 2021
[test] Make sure users cant receive typing notifications/read receipts if we ignored them, or their server has been ACLd Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

matrix-org/complement#255 · Opened Dec 2, 2021
There is no way to extract deployment-created room IDs after the fact Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#254 · 9 comments · 1 reaction · Opened Dec 2, 2021
Consider using a single file-naming scheme and test grouping methodology Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#241 · 2 comments · Opened Dec 1, 2021
Autogen per-test docs for discoverability Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#240 · 3 comments · Opened Dec 1, 2021
Support E2EE rooms Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#231 · 2 comments · 1 reaction · Opened Nov 19, 2021
Support application services Open

app-service enhancement

matrix-org/complement#228 · 2 comments · 1 assignee · Opened Nov 19, 2021
Build tag configuration duplicated in many places Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

matrix-org/complement#185 · 4 comments · Opened Aug 4, 2021
Support HS upgrade tests Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

matrix-org/complement#150 · 3 comments · Opened Jul 8, 2021

matrix-org/complement

Get new issues in your inbox