Pan function does not work properly when there are many points

I am using Chart.js in an Angular application.
When zooming in, the pan function does not work properly when there are many points. Only the range from the beginning to the end can be displayed.
When the range displayed contains more than 650 points, the issue arises. If I zoom to display fewer than 650 points, it works correctly.

example:
https://stackblitz.com/edit/angular-chartjs-plugin-zoom-bnevsf

Start with the linked StackBlitz reproduction and test panning when the displayed range contains more than 650 points, comparing it with ranges below that threshold. Trace the plugin's pan behavior from the reproduction to identify where the full zoomed range is restricted. Done means panning works across the complete available range with many points as well as with smaller ranges.

Written by the indexing model from the issue text.