Voice calls broke until Element restarted

### Steps to reproduce

1. I switched to a different server
2. I added my friend who's still on matrix.org
3. They replied and we tried a voice call and neither of us could hear the other
4. After trying multiple times, I switched back to matrix.org and it still wasn't working
5. I restarted Element and it still didn't work
6. They restarted Element and it suddenly started working again

### Outcome

#### What did you expect?
For voice calls to keep working

#### What happened instead?
Voice calls stopped working

### Operating system

Windows 10

### Application version

Element version: 1.11.18 Olm version: 3.2.12 (me) / Element version: 1.11.22 Olm version: 3.2.12 (them)

### How did you install the app?

From main website

### Homeserver

matrix.org and vern.cc

### Will you send logs?

Yes