#goto stops when enters unloaded chunks while using timer

## Some information
Operating system: MacOS
Java version:17
Minecraft version:1.19.4
Baritone version: baritone-api-fabric-1.9.3.jar
Other mods (if used): CoordinatesDisplay-2.2.0mc1.19.4.jar, DistantHorizons-1.6.11a-1.19.4.jar, fabric-api-0.75.3+1.19.4 (1).jar, Fastload+1.18.2-1.20-3.3.8.jar, malilib-fabric-1.19.4-0.15.3.jar, Wurst-Client-v7.32-MC1.19.4.jar

## Exception, error or logs
[debug.log](https://github.com/cabaletta/baritone/files/11348776/debug.log)
(Sorry that this debug file is two days long.)

## How to reproduce
Use #goto command on nether roof and set timer hack (I used Wurst) to a value of at least 5 and wait until it reaches unloaded chunks and it should stop.

## Modified settings
20:00:43.052
[System] [CHAT] [Baritone] > modified
20:00:43.065
[System] [CHAT] [Baritone] All modified settings:
20:00:43.072
[System] [CHAT] [Baritone] allowDiagonalAscend (Boolean)
20:00:43.072
[System] [CHAT] [Baritone] allowDiagonalDescend (Boolean)
20:00:43.072
[System] [CHAT] [Baritone] allowInventory (Boolean)
20:00:43.073
[System] [CHAT] [Baritone] allowParkour (Boolean)
20:00:43.073
[System] [CHAT] [Baritone] allowParkourPlace (Boolean)
20:00:43.073
[System] [CHAT] [Baritone] allowSprint (Boolean)
20:00:43.073
[System] [CHAT] [Baritone] allowVines (Boolean)
20:00:43.073
[System] [CHAT] [Baritone] avoidance (Boolean)
20:00:43.076
[System] [CHAT] [Baritone] << | >> 1/1

## Final checklist
- [x] I know how to properly use check boxes
- [x] I have included the version of Minecraft I'm running, baritone's version and forge mods (if used).
- [x] I have included logs, exceptions and / or steps to reproduce the issue.
- [x] I have not used any OwO's or UwU's in this issue.