Sending an encrypted message in a room (sometimes) can take a while to send, even with 2 people

### Steps to reproduce

1. Go to an encrypted room
2. Send a message there

### Intended result and actual result

#### What did you expect?
Message sends in less than 2-4 seconds in the encrypted room

#### What happened instead?
The message (sometimes) takes a while to send in the encrypted room, though it's likely just the network, I guess

### Your phone model

Mito W1

### Operating system version

Android 9

### Application version and app store

Element version 1.3.4, olm version 3.2.4 from GitHub

### Homeserver

matrix.org

### Will you send logs?

No