Fallback to next server when connection errors out

I host a server for a few friends on a low-end server, sometimes the connection gets closed with the message "Connection reset by peer", but you can reconnect again.
I decided I wanted to fallback to another server when you get kicked out, which then tries to automatically connect you back, so I got a velocity plugin which does that. The plugin seems to work, I /kick myself out and it reconnects me.
However, when the connection does get reset, it still just kicks me out.
Logs:

[connected player] _Cfp has disconnected: An internal error occurred in your connection.
[connected player] _Cfp: exception encountered in com.velocitypowered.proxy.connection.client.ClientPlaySessionHandler@3612d08e
io.netty.channel.unix.Errors$NativeIoException: recvAddress(..) failed: Connection reset by peer
[server connection] _Cfp -> has disconnected

Start by tracing the logged com.velocitypowered.proxy.connection.client.ClientPlaySessionHandler path for the Netty Connection reset by peer error. Compare this failure with the plugin's working /kick behavior and identify whether the connection reset reaches the fallback flow. Done means a reset connection triggers the expected automatic reconnect instead of only disconnecting the player.