spanGaps not working near min and max limits

### Expected behavior

I show a line chart based on a dataset with a few `null` values.
```
labels: [0, 10, 20, 30, 40, 50, 60, 70, 80, 90, 100],
datasets: [{
label: '# of Votes',
data: [3, null, 2, 3, 2, 3, 5, 4, 3, null, 5],
spanGaps: true,
tension: 0.4
}]
```

I set a min and max limit for the `x` axis near the `null` values.
```
scales: {
x: {
type: 'linear',
min: 11,
max: 90,
}
}
```

I expect the gaps to be spanned in the same way with or without the x scale limits.

### Current behavior

Gaps are not spanned near min and max limits.

### Reproducible sample

https://codepen.io/marisst/pen/GRVEyGK

### Optional extra steps/info to reproduce

_No response_

### Possible solution

_No response_

### Context

This issue is very painful when creating zoomable and pannable charts with `chartjs-plugin-zoom` because the whole plug-in relies on scale min and max limits. However, the issue is not in the plugin itself, but in the core chart.js library.

https://github.com/user-attachments/assets/34c877a4-bd23-48d9-ba3d-231f0cd7c0ce

### chart.js version

v4.4.5

### Browser name and version

_No response_

### Link to your project

_No response_