Invalid room invites rejected from another device

### Steps to reproduce

1. Set up your account in element web and android (2 devices)
2. Receive a private conversation invite
3. Reject invite from element web
4. Go to element android and see that invite is still there
5. Try to accept or reject and see an error and invite is still there
6. Clear cache and invite is gone

### Outcome

#### What did you expect?
Invite should be gone when rejected from another device.

#### What happened instead?
Can't delete invite request unless you clear cache in android device.

### Your phone model

TCL T771K

### Operating system version

Android 12

### Application version and app store

Element android 1.6.18 + Element web v1.11.73

### Homeserver

Synapse 1.112.0

### Will you send logs?

No

### Are you willing to provide a PR?

No