Can't rejoin restricted room by id

### Steps to reproduce

1. Create a space (`!new_space:b.example.com`) that is restricted to some other room (in this case not a space, but a different normal room) on server B
```
{
"allow": [
{
"room_id": "!somechatroom:b.example.com",
"type": "m.room_membership"
}
],
"join_rule": "restricted"
}
```

2. Join the room via a link from server A:

https://matrix.to/#/!new_space:b.example.com?via=b.example.com


3. Press join, then leave the space

4. Try to rejoin, the link will now be rich:



The button is disabled.

5. note that you can actually join the room by pasting the link into a `/join`

### Outcome

#### What did you expect?
To be able to rejoin the room in the UI

#### What happened instead?
I was not able to join the room in the UI

### Operating system

NixOS

### Browser information

Firefox 129.0

### URL for webapp

_No response_

### Application version

Element version: 1.11.77 Crypto version: Rust SDK 0.7.1 (c8c9d15), Vodozemac 0.6.0

### Homeserver

Synapse 1.115.0

### Will you send logs?

No