Previously used space not used upon reopening of element

### Steps to reproduce

When opening element and choosing a specific space, closing element and then opening element again, the previously chosen space is not kept. This doesn't seem to happen every time, but it happens quite often.

https://github.com/vector-im/element-android/assets/29256280/a3b7ac5d-829c-48c5-b595-f5ad71b675ab

### Outcome

^^^^

### Your phone model

Samsung Galaxy A52s 5g

### Operating system version

LineageOS 20

### Application version and app store

1.6.3 [40106032] (G-f5f4d4a3)

### Homeserver

No clue, seems to be a client issue

### Will you send logs?

No

### Are you willing to provide a PR?

No