"Take me to the oldest unread message" button doesn't take me back all the way to the oldest unread message

### Steps to reproduce

Clicking the below button doesn't always take me all the way back to the first unread message. Same issue with the "take me to the message that mentioned me" button.

I believe this happens when there was a lot of activity since last time. It seems that clicking the button multiple times (and waiting until something happens each time you click, sigh) takes me to the message eventually.

### What happened?

### What did you expect?
Clicking the button takes me to the first unread message or to the message that mentioned me.

### What happened?
It stops scrolling up before it reaches the message.

Possibly related: https://github.com/vector-im/element-web/issues/19170

### Operating system

_No response_

### Application version

Element version: 1.9.0 Olm version: 3.2.3

### How did you install the app?

_No response_

### Homeserver

matrix.org

### Have you submitted a rageshake?

No