baritone gets stuck in a build loop

## What do you need help with?

baritone build a schem

With as much detail as possible, describe your question and what you may need help with.

im trying to build a schematic file and it starts okay at first then during the first layer it will randomly start walking back and forth between two points and not building, it gets stuck in this loop every time on a server, in singleplayer on a super flat with the same settings it dosent get stuck in a loop but on the server im on (5b5t) it gets stuck in this loop

my modified settings are
allowinvitiory
allowparkour
allowparkourplace
allowsprint
allowvines
buildingoreexisting
buildinlayers
chatcontrol
followradius
startatlayer 1 (this dosent do anything for the loop)

## Final checklist
- [x] I know how to properly use check boxes
- [x] I have not used any OwO's or UwU's in this issue.