App performance progressively degrades over the week after clearing cache

### Steps to reproduce

1. Be in a couple hundred rooms
2. Notice that overall app performance has become unusably slow
3. Clear the cache from the general page of settings
4. Notice that the app is suddenly much more responsive overall
5. Use the app for a week
6. Notice that over the course of the week, the app becomes progressively slower until it becomes unusable again

### Outcome

#### What did you expect?

The app should remain responsive without manual intervention.

#### What happened instead?

Nearly all interactions (button presses, navigating through the room list, opening rooms, long tapping on a message, switching spaces) take 15 to 45 seconds.

https://user-images.githubusercontent.com/48614497/180242388-c5462d95-7f27-4a0e-8ae2-3d811c34aeda.mp4

### Your phone model

Google Pixel 3a

### Operating system version

LineageOS 19.1 (Android 12)

### Application version and app store

1.4.25 [40104250] (F-1f34d368)

### Homeserver

Synapse 1.62.0

### Will you send logs?

Yes

### Are you willing to provide a PR?

No