Pressing "back" button goes two or more folders up in the hierarchy

### ⚠️ Before posting ⚠️

- [x] This is a **bug**, not a question or an enhancement.
- [x] I've [searched for similar issues](https://github.com/nextcloud/android/issues) and didn't find a duplicate.
- [x] I've written a clear and descriptive title for this issue, not just "Bug" or "Crash".
- [x] I agree to follow Nextcloud's [Code of Conduct](https://nextcloud.com/contribute/code-of-conduct/).

### Steps to reproduce

1. open app
2. go to favorites folder and open one (bug doesn't seem to apply if one opens all the files)
3. navigate in the folders, open some nested subfolders
4. click "back" android button and the app will not go in the parent folder, but in the parent of the parent

### Expected behaviour

If I open:
Favorite > Folder 1 > Subfolder 2 > Subsubfolder 3

and I press back, I expect the app will open:
Favorite > Folder 1 > Subfolder 2

### Actual behaviour

Instead, it will open:
Favorite > Folder 1

### Android version

10

### Device brand and model

Fairphone 3

### Stock or custom OS?

Stock

### Nextcloud android app version

3.31.4 Fdroid

### Nextcloud server version

29.0.16

### Using a reverse proxy?

Yes

### Android logs

_No response_

### Server error logs

```bash

```

### Additional information

This behavior is rather unpredictable, it happens most of the times, sometimes it doesn't, sometime it goes three folders up. I have the feeling it tends to happen less if the folder fully loads the list of files and subfolder before opening one, but this is not always the case.