Room jumps up and hides recent messages

### Steps to reproduce

1. Start scrolling up in a specific room (id to come in Rageshake
2. Get to a specific point scrolling up, and the room jumps up by about the amount scrolled
3. Scroll back down and recent messages are not visible. Newest messages are 4-5 hours old (roughly where I got to when scrolling up
4. Navigating away and then back to the room puts me back to recent messages again

### Outcome

#### What did you expect?

I should be able to scroll up and down the room, without jumping and with a consistent set of messages visible

#### What happened instead?

Room jumps and then hides recent messages

### Operating system

Ubuntu 24.04

### Application version

Element version: 1.11.83 Crypto version: Rust SDK 0.7.2 (7a21514), Vodozemac 0.7.0

### How did you install the app?

Offical Deb

### Homeserver

Synapse 1.118

### Will you send logs?

Yes