Suggested rooms not appearing to new users to a private space

### Steps to reproduce

1. I get invited to a private space, accepted it, then left the private space after a while. After I left, the space creator marks the space's rooms as suggested, and invites me again.
2. I get the invite, and accepted the private space invitation.

### Intended result and actual result

#### What did you expect?
I see the suggested rooms in the private space

#### What happened instead?
I didn't see the suggested rooms in the private space

### Your phone model

Mito W1

### Operating system version

Android 9

### Application version and app store

Element version 1.3.4, olm version 3.2.4 from GitHub

### Homeserver

matrix.org

### Will you send logs?

No