element-hq / element-hq/synapse
[Meta] List of flaky Synapse tests
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 600
- Avg merge
- 5d 22h
- Merged PRs (30d)
- 51
Description
We'd like to compile a central list of flaky tests, so that they can be disabled/fixed as necessary in order to get CI back into a reliable state. This list should be edited by the team as flakes are found.
- `trial (3.9, sqlite, all)`
- [x] `twisted.protocols.amp.TooLong` ([1](https://github.com/element-hq/synapse/actions/runs/16433216848/job/46438409928?pr=18474#step:9:6750), [2](https://github.com/element-hq/synapse/actions/runs/16449690724/job/46491509587#step:9:6232), [3](https://github.com/element-hq/synapse/actions/runs/16476761141/job/46580537856)) ⇒ https://github.com/element-hq/synapse/pull/18736 and https://github.com/element-hq/synapse/pull/19832
- [ ] `tests.replication.test_sharded_event_persister.EventPersisterShardTestCase.test_basic` ([1](https://github.com/element-hq/synapse/actions/runs/17984959377/job/51160815336?pr=18721#step:9:6383))
- `trial (3.10, postgres, 14, all)`
- [x] `tests.rest.admin.test_user.UserRedactionBackgroundTaskTestCase.test_redact_messages_all_rooms` ([1](https://github.com/element-hq/synapse/actions/runs/23623618676/job/68808138687?pr=19611#step:9:6661), [2](https://github.com/element-hq/synapse/actions/runs/25397317204/job/74487985678?pr=19755)) -> https://github.com/element-hq/synapse/pull/19890
- `sytest (bullseye)`
- [ ] `After /purge_history users still get pushed for new messages` ([1](https://github.com/element-hq/synapse/actions/runs/21269645011/job/61216979498?pr=19404))
- `sytest (bullseye, postgres)`
- [ ] `After /purge_history users still get pushed for new messages` ([1](https://github.com/element-hq/synapse/actions/runs/15418884318/job/43388608498#step:8:11), [2](https://github.com/element-hq/synapse/actions/runs/15615213659/job/43986306223?pr=18543#step:8:11), [3](https://github.com/element-hq/synapse/actions/runs/17730684460/job/50381276982?pr=18921#step:8:11), [4](https://github.com/element-hq/synapse/actions/runs/18308953978/job/52133077232?pr=17097#step:8:12) [5](https://github.com/element-hq/synapse/actions/runs/18385184500/job/52381908459?pr=19027))
- [ ] `Newly joined room includes presence in incremental sync` ([1](https://github.com/element-hq/synapse/actions/runs/16433447858/job/46439072417?pr=18474#step:8:11))
- `sytest (bullseye, multi-postgres, workers)`
- [ ] [many tests](https://github.com/element-hq/synapse/actions/runs/15622706351/job/44011028549?pr=18540#step:8:1)
- ` sytest (bullseye, asyncio)`
- [ ] `After /purge_history users still get pushed for new messages` ([1](https://github.com/element-hq/synapse/actions/runs/18385053764/job/52381473885))
- `sytest (bullseye, multi-postgres, workers, asyncio)`
- [ ] many tests ([1](https://github.com/element-hq/synapse/actions/runs/15556780003/job/43799760371#step:8:11), [2](https://github.com/element-hq/synapse/actions/runs/15847758446/job/44673977168?pr=18577), [3](https://github.com/element-hq/synapse/actions/runs/15899557318/job/44839252836?pr=18241), [4](https://github.com/element-hq/synapse/actions/runs/15969963864/job/45038950418?pr=18605), [5](https://github.com/element-hq/synapse/actions/runs/16415632570/job/46381105978?pr=18703), [6](https://github.com/element-hq/synapse/actions/runs/16415784316/job/46381647188?pr=18706), [7](https://github.com/element-hq/synapse/actions/runs/16460897940/job/46527875675?pr=18715), [8](https://github.com/element-hq/synapse/actions/runs/18048064433/job/51363776447?pr=18868), [9](https://github.com/element-hq/synapse/actions/runs/23767284844/job/69250185894?pr=19533))
- Complement (`workers, postgres`)
- [ ] `TestFederationRoomsInvite` (`/Parallel/Remote_invited_user_can_reject_invite_when_homeserver_is_already_participating_in_the_room`) ([1](https://github.com/element-hq/synapse/actions/runs/16674591068/job/47198433967?pr=18763#step:7:20767), [2](https://github.com/element-hq/synapse/actions/runs/17072596848/job/48414741416?pr=18791). [3](https://github.com/element-hq/synapse/actions/runs/18018555959/job/51269908359), [4](https://github.com/element-hq/synapse/actions/runs/18112966681/job/51543157063?pr=18992), [5](https://github.com/element-hq/synapse/actions/runs/18385053764/job/52381462326), [6](https://github.com/element-hq/synapse/actions/runs/19686545668/job/56393431943?pr=19203), [7](https://github.com/element-hq/synapse/actions/runs/22148194476/job/64031851336?pr=19475), [8](https://github.com/element-hq/synapse/actions/runs/27131399356/job/80092190241?pr=19828)), https://github.com/element-hq/synapse/issues/19858
- [ ] `TestFederationRoomsInvite/Parallel/Invited_user_can_reject_invite_over_federation_several_times` ([1](https://github.com/element-hq/synapse/actions/runs/16449690724/job/46491493845#step:7:20808))
- [ ] `TestFederationRoomsInvite/Parallel/Inviter_user_can_rescind_invite_over_federation` ([1](https://github.com/element-hq/synapse/actions/runs/17912499907/job/51051534098?pr=18949#step:7:21070), [2](https://github.com/element-hq/synapse/actions/runs/22687017390/job/65773142999?pr=19487), [3](https://github.com/element-hq/synapse/actions/runs/23076108996/job/67265023982))
- [ ] `TestPartialStateJoin/Outgoing_device_list_updates/Device_list_updates_reach_newly_joined_servers_in_partial_state_rooms` ([1](https://github.com/element-hq/synapse/actions/runs/16048601913/job/45285748483?pr=18646#step:7:24730), [2](https://github.com/element-hq/synapse/actions/runs/16574453763/job/46875647564?pr=18745#step:7:40734), [3](https://github.com/element-hq/synapse/actions/runs/16883162524/job/47824151647?pr=18798#step:7:11811), [4](https://github.com/element-hq/synapse/actions/runs/16725650933/job/47340671509?pr=18775#step:7:25782), [5](https://github.com/element-hq/synapse/actions/runs/22736160687/job/65938244296?pr=19476))
- [ ] `TestPartialStateJoin/Outgoing_device_list_updates/Device_list_updates_reach_all_servers_in_partial_state_rooms` ([1](https://github.com/element-hq/synapse/actions/runs/16602354592/job/46971465350#step:7:35867))
- [x] `TestDelayedEvents/delayed_state_events_are_kept_on_server_restart`) ([1](https://github.com/element-hq/synapse/actions/runs/16295532252/job/46016034910), [2](https://github.com/element-hq/synapse/actions/runs/16312708593/job/46071441667#step:5:18645)) -> https://github.com/matrix-org/complement/pull/830 and https://github.com/matrix-org/complement/pull/869
- [ ] `TestThreadedReceipts` ([1](https://github.com/element-hq/synapse/actions/runs/16295532252/job/46016034910#step:5:3487), [2](https://github.com/element-hq/synapse/actions/runs/18197499669/job/51807739338?pr=19007), [3](https://github.com/element-hq/synapse/actions/runs/19686545668/job/56427171970?pr=19203), [4](https://github.com/element-hq/synapse/actions/runs/22775783342/job/66068874081?pr=19533), [5](https://github.com/element-hq/synapse/actions/runs/23158057160/job/67278330247#step:12:7097))
- [ ] `TestThreadReceiptsInSyncMSC4102` ([1](https://github.com/element-hq/synapse/actions/runs/16452225307/job/46500313848?pr=18540#step:7:3557) [2](https://github.com/element-hq/synapse/actions/runs/16604117994/job/46971540141?pr=18737), [3](https://github.com/element-hq/synapse/actions/runs/17672342966/job/50226764610?pr=18848#step:7:3592), [4](https://github.com/element-hq/synapse/actions/runs/17730486632/job/50380608776?pr=18919#step:7:3497), [5](https://github.com/element-hq/synapse/actions/runs/18021157721/job/51278706782), [6](https://github.com/element-hq/synapse/actions/runs/18048064433/job/51363765437?pr=18868), [7](https://github.com/element-hq/synapse/actions/runs/18913846046/job/53992070059?pr=19099), [8](https://github.com/element-hq/synapse/actions/runs/22506279263/job/65205713911?pr=19510#step:9:7866), [9](https://github.com/element-hq/synapse/actions/runs/23076108996/job/67036787233#step:12:7150), [10](https://github.com/element-hq/synapse/actions/runs/24389453448/job/71233383755?pr=19613)) -> https://github.com/element-hq/synapse/issues/19171
- [x] `TestAsyncUpload/Cannot_upload_to_a_media_ID_that_has_already_been_uploaded_to` ([1](https://github.com/element-hq/synapse/actions/runs/16312708593/job/46071441667#step:5:15625)) -> https://github.com/matrix-org/complement/pull/839
- [ ] `TestTxnIdempotencyScopedToDevice` ([1](https://github.com/element-hq/synapse/actions/runs/16602354592/job/46969094804))
- [ ] `TestDeviceListUpdates` ([1](https://github.com/element-hq/synapse/actions/runs/16602354592/job/46969094804), [2](https://github.com/element-hq/synapse/actions/runs/23076108996/job/67270327225#step:12:6997))
- [ ] `TestRoomSummaryAllowedRoomIDs/restricted_room_includes_allowed_room_ids` ([1](https://github.com/element-hq/synapse/actions/runs/28601133960/attempts/4?pr=19871), [2](https://github.com/element-hq/synapse/actions/runs/28599579192/job/84804429764?pr=19897)), https://github.com/element-hq/synapse/issues/19905
- Complement (`monolith, SQLite`, [2](https://github.com/element-hq/synapse/actions/runs/16884311384/job/47828138018?pr=18800#step:7:3494))
- [ ] `TestPartialStateJoin` (`TestPartialStateJoin/Leave_during_resync/works_after_a_second_partial_join`)
- [ ] `TestPartialStateJoin/Outgoing_device_list_updates/Device_list_updates_reach_incorrectly_absent_servers_once_partial_state_join_completes` ([1](https://github.com/element-hq/synapse/actions/runs/16478817232/job/46587596267#step:7:11757), [2](https://github.com/element-hq/synapse/actions/runs/18112966681/job/51543157041?pr=18992))
- [ ] `TestPartialStateJoin/Outgoing_device_list_updates/Device_list_updates_reach_incorrectly_kicked_servers_once_partial_state_join_completes` ([1](https://github.com/element-hq/synapse/actions/runs/18318299954/job/52167455899?pr=19013), [2](https://github.com/element-hq/synapse/actions/runs/18946221968/job/54098334339?pr=19094))
- [ ] `TestOutboundFederationSend` ([1](https://github.com/element-hq/synapse/actions/runs/16341981805/job/46166665530?pr=18675#step:7:2709))
- Complement (`monolith, Postgres`)
- [ ] `TestMSC4289PrivilegedRoomCreators/admin_with_>PL100_sorts_after_the_room_creator_for_state_resolution` ([1](https://github.com/element-hq/synapse/actions/runs/18096787387/job/51490191615?pr=18980#step:7:12301))
- [ ] `TestPartialStateJoin/Outgoing_device_list_updates/Device_list_updates_reach_newly_joined_servers_in_partial_state_rooms` ([1](https://github.com/element-hq/synapse/actions/runs/22506279263/job/65205713882?pr=19510#step:9:18484))
Contributor guide
Assessment
This issue has not been assessed yet.