use `gd` jump to define but a cursor movement immediately brings focus back to original cursor position

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

when I use gd to jump to variable or function definition, and ues h / j / k / l move the cursor, the cursor focus back to origina position; I have try Help: Start Extension Bisect and found that (maybe) not the other extendtion problem, cause when this happend and I relunch vscode, this issue gone. This issue often occurs after vscode being used for a long time and open more than one window, but sorry I dont know how to reproduce it.

this issue happen everyday in my vscode, I really dont know should I report this problem to you or VScode.

Expected behavior
jump to definition, and not go back to origin position when move the cursor

Screenshots
the behavior like this link

Environment (please complete the following information):

• Extension (VsCodeVim) version: 1.23.2
• VSCode version: 1.70.1
• OS: MacOS Monterey 12.2.1

Start with the VSCodeVim gd jump behavior and the h/j/k/l cursor-movement path described in the report. Try reproducing it across multiple VS Code windows and after a long session, then compare behavior before and after relaunching VS Code. Done means movement after jumping to a definition no longer returns focus to the original position.