[Feature]: toggle term without putting focus on it.

My use case:

I have a command to toggle all TUI on and off but not the open text buffers.
So say I have Nvim-tree and ToggleTerm I hide both and show both when I toggle.

But when I toggle the terminal interface on it automatically take over focus and put it self in insert mode in the terminal.
That is ok if I start a terminal and know I need to do something in the terminal, but not in this use case I would rather stay on the last focused window and let the me decide what to do.

So is there a way of turn this off I have not found any solution but maybe I missed it?