docker-from-docker: vscode soft-reloading on running any `docker` command

I'm running a devcontainer with a custom debian `bullseye`-based image. I'm installing only the docker cli inside the container using `COPY --from=hub.docker.com/docker:dind /usr/local/bin/docker /usr/local/bin/`. I'm mounting the docker socket and authentication keys in the `~/.docker` folder.

`docker` commands inside the devcontainer are working fine, it's interacting with the remote host docker daemon and doing whatever I tell it, however everytime I run a `docker` command vscode _soft reloads_ the entire UI, as in the whole window refreshes. The terminal appears to continue in the background and nothing really breaks, it's just a very janky user experience if I have to wait 5-10s every time I run a docker command to wait for the UI to reload.

Is there any way of preventing the reload?

Thanks