A group chat being in a space should not appear the same as a user joining a space.

### Steps to reproduce

1. Invite a user to a private space
2. See them in the space
3. Create a dm with another user and add the dm to the same space
4. See that user in the space?

### Outcome

#### What did you expect?
I expected users in a space to be separate from chats in a space.
#### What happened instead?
That was not the case.

### Operating system

Windows 10

### Application version

Element version: 1.9.8 Olm version: 3.2.8

### How did you install the app?

https://community.chocolatey.org/packages/element-desktop

### Homeserver

yiff.social

### Will you send logs?

No