Shaking cursor while mining

## Some information
Operating system: `Windows 10 Home Single Language`
Java version: `java 21.0.2 2024-01-16 LTS`
Minecraft version: `1.20.4`
Baritone version: `fabric-1.10.2`
Other mods (if used): Nothing else, only baritone

## Exception, error or logs
There is no revelant error in logs, just:
```
[22:00:28] [Render thread/INFO]: [CHAT] [Baritone] > sel ca
[22:00:28] [Render thread/INFO]: [CHAT] [Baritone] Filling now
[22:03:45] [Render thread/INFO]: [CHAT] [Baritone] Done building
```

## How to reproduce
1. Select an area and clear it via `#sel cleararea`
2. Observe.

My results:
1. Cursor shaking, missing the target and restarting mining, barely able to mine its target
2. Mod will not be able to choose a block to mine if two blocks are in about the same distance, alternating between them and not able to mine any of them.

Manually moving the character closer will slightly help but what's the point of using this then?

[Video for clarity](https://streamable.com/9mdip1)

## Modified settings
```
allowDiagonalAscend = true
allowJumpAt256 = true
allowParkour = true
allowParkourPlace = true
allowVines = true
blockReachDistance = 4.0
breakFromAbove = true
freeLook = false
maxFallHeightBucket = 400
maxFallHeightNoWater = 10
minYLevelWhileMining = -64
verboseCommandExceptions = true
```

## Final checklist
- [x] I know how to properly use check boxes
- [x] I have included the version of Minecraft I'm running, baritone's version and forge mods (if used).
- [x] I have included logs, exceptions and / or steps to reproduce the issue.
- [x] I have not used any OwO's or UwU's in this issue.