[Bug]: Increased reports of desyncs after 3822

### Describe the Bug

People have been reporting more desyncs after version 3822.
It might be related to #6692, but we need more data.

### Reproduce the bug

#24948784
https://forum.faforever.com/topic/5702/desyncs/13
- [24947373](https://replay.faforever.com/24947373)
Log

INFO: ueb0202 55 OnFailedToBuild set collisions hape 3477
DEBUG: Moderator event for leveling: Self-destructed 1 units
DEBUG: Moderator event for Alive_Pulsar: Self-destructed 1 units
WARNING: Checksum for beat 3550 mismatched: b930d98e33615770cec678481c26d2b6 (sim) != 606513c591373a5e975b12fe5b7e23ad (Toka).
WARNING: Checksum for beat 3550 mismatched: b930d98e33615770cec678481c26d2b6 (sim) != 606513c591373a5e975b12fe5b7e23ad (Alive_Pulsar).
WARNING: Checksum for beat 3550 mismatched: b930d98e33615770cec678481c26d2b6 (sim) != 606513c591373a5e975b12fe5b7e23ad (Dmitry11).
WARNING: Checksum for beat 3550 mismatched: b930d98e33615770cec678481c26d2b6 (sim) != 606513c591373a5e975b12fe5b7e23ad (HOSCHMOSCH).
WARNING: Checksum for beat 3550 mismatched: b930d98e33615770cec678481c26d2b6 (sim) != 606513c591373a5e975b12fe5b7e23ad (Figga).

### Screenshots

_No response_

### Additional context

_No response_