Can't view another thread after jumping to pinned message

### Steps to reproduce

1. enable message pinning (labs)
2. have a thread
3. have another thread
4. pin one thread root, it does not matter which
5. come back a month later with a good amount of messages in the meantime
6. click view message in the pins panel
7. try to open the other thread

### Outcome

#### What did you expect?
the other thread is shown
#### What happened instead?
- it switches to the other thread for a split second and then goes back to showing the pinned thread immediately.
- try to leave the thread view and it jumps back to the very bottom of the TL ("now")
- try to scroll further than a dozen messages => #26080

### Operating system

arch

### Application version

Element Nightly version: 2023102801 Crypto version: Olm 3.2.15

### How did you install the app?

aur

### Homeserver

synapse 1.93

### Will you send logs?

Yes