Chart x offset changes when finished zooming in

I'm seeing a weird behavior when I zoom in my charts.

After I end zooming (which means releasing both fingers) the xAxis offset changes as it moves like 20 chart points to the right of where the zoom ended.

The chart is inside another scrollview, but has only vertical scroll. Also this only happens when the zoom level is really close.. not sure exactly when.
My code is pretty much the same as the demo.. only a few changes here and there.

Here's a video with the behaviour I'm seeing https://youtu.be/6ZIJmTyuie4
Any idea on why this is happening or how can I fix it?