Back button behaves in expected but unhelpful way when joining and interacting with a new room

### Steps to reproduce

1. Search for a new room to join
2. Click on it to join
3. Click again to go to room
4. Start interacting with the room and forget that you got there through the join screen
5. Use system back button to get back to the room list
6. Be surprised that you're looking at a search result of one room which is ticked

### Intended result and actual result

#### What did you expect?
I forgot that I got here from the join view and was expecting to go back to my room list

#### What happened instead?
Unexpected view which is momentarily confusing

### Your phone model

_No response_

### Operating system version

Android 11

### Application version and app store

Element 1.3.4 (RC)

### Homeserver

_No response_

### Will you send logs?

No