Permalinks scroll to the wrong place most of the time.

### Steps to reproduce

1. Click on a permalink (e.g. from a search result)
2. Get teleported somewhere 2-3 pages above the actual search result
3. Have to scroll down and find it.

This has been regressed for many months - roughly since the same time as https://github.com/element-hq/element-web/issues/27312.

https://github.com/element-hq/element-web/assets/1294269/5fe0a858-fc9a-485f-b864-66ce7be90013

### Outcome

#### What did you expect?

The highlighted permalink should be shown halfway down the visible window into the timeline.

#### What happened instead?

The scroll offset behaves as if there's been a massive scroll jump; the permalink is anywhere from 1 to 3 pages off the bottom of the page. (Or sometimes above it).

### Operating system

_No response_

### Application version

Element Nightly version: 2024053001 Crypto version: Rust SDK 0.7.0 (068a0af), Vodozemac 0.6.0

### How did you install the app?

_No response_

### Homeserver

_No response_

### Will you send logs?

No