Display focus jumps after changing space

Hey there! Thanks for your amazing work on yabai – it is pure bliss!

I am experiencing issue of display focus jumping to other display (I have 2 of them) when I change the space focus.

Space changes correctly all of the time, but occasionally display focus jumps to other display (it happens ~20% of the time)

Here are the commands that I use to change space:

```
# Desktops Navigation (four spaces per display): hyper - {1, 2, 3, 4}
hyper - 1 : DISPLAY="$(yabai -m query --displays --display | jq '.index')"; yabai -m space --focus $((1+4*($DISPLAY - 1)))
hyper - 2 : DISPLAY="$(yabai -m query --displays --display | jq '.index')"; yabai -m space --focus $((2+4*($DISPLAY - 1)))
hyper - 3 : DISPLAY="$(yabai -m query --displays --display | jq '.index')"; yabai -m space --focus $((3+4*($DISPLAY - 1)))
hyper - 4 : DISPLAY="$(yabai -m query --displays --display | jq '.index')"; yabai -m space --focus $((4+4*($DISPLAY - 1)))
```
I would appreciate any help!

Start by reproducing the intermittent jump with the four hyper-key commands and the two-display setup described in the issue. Trace the display and space focus handling around these commands, then verify that changing a space keeps focus on the selected display every time.

Written by the indexing model from the issue text.