Visual mode gets activated by accident when mouse clicking in the whitespace at the end of a line

Describe the bug
I often mouse click on the right side of a line, to quickly position the cursor where I want to edit. In most cases, I accidentally activate visual mode, because the mouse pointer needs to just move a single pixel to activate visual mode. It forces me to press Esc each time to get back to normal mode.

I know that entering visual mode by mouse can be disabled in settings, but I want to use this feature for text selection.

When clicking on text, the behaviour is fine, because visual mode only gets activated when dragging over a character boundary, not simply by moving a single pixel distance. The bug might have something to do with the invsible line ending character (just a guess).

To Reproduce

1. Use a mouse, not a trackpad
2. Start in normal mode
3. Left-click somewhere to the right of a line of text and move the mouse pointer at least one pixel (horizontally), while still holding down the left mouse button
4. Let go of the mouse button
5. Notice that visual mode is now active

Expected behavior
I expect to have the cursor placed at the end of the line, still in normal mode.

Environment (please complete the following information):

• Extension (VsCodeVim) version: 1.27.2
• VSCode version: 1.85.1
• OS: macOS 14.2.1

No file or test is named. Reproduce the mouse interaction in VSCodeVim using the reported VS Code, extension, and macOS versions, then trace the mouse handling involved; done means clicking and moving one pixel in line whitespace places the cursor at the line end without activating visual mode, while text selection still works.