dirvish buffers are killed too often

### I confirm that...

- [x] I searched the issue tracker and found no similar issues.

- [x] I searched the [documentation](https://docs.doomemacs.org), [FAQ](https://docs.doomemacs.org/-/faq), [discussion board](https://doomemacs.org/discuss), and [Google](https://google.com) for solutions to my issue.

- [x] I read [the debugging guide](https://doomemacs.org/d/how2debug) and researched the issue to the best of my ability.

- [x] My issue can be observed on the latest available commit of Doom.

- [x] My issue can be observed on a stable release of Emacs (i.e. doesn't end in `.50`, `.60`, or `.90`–`.99`)

### Describe your issue

When using dirvish its buffers get closes too early.

### Steps to reproduce

Start by running dirvish-fd on a directory with sub directories having sub directories.

It opens dirvish in a window.
Hit return on a sub directory opens that in another window.
Go to the second window and hit return on a sub directory it opens that in the original window.
Go to that window and hit q to close it.

Where is the original dired/dirvish buffer?

### System information

https://pastebin.com/hvm7QQvX