React aria components DateField unexpected behavior when reentering years with trailing zeroes

### Provide a general summary of the issue here

Not being able to reliably and predictably enter a year in the year date segment

### 🤔 Expected Behavior?

I should be able to enter any year at any point without deleting everything written in the year field.

### 😯 Current Behavior

I cant reenter years with trailing zeroes without first deleting all digits written in the year field.

### 💁 Possible Solution

_No response_

### 🔦 Context

_No response_

### 🖥️ Steps to Reproduce

Steps to reproduce:
1. Enter a full 4 digit year in DateField
2. Start reentering (type any digit higher than 0)
3. start typing zeroes

Randomly it will stop entering new values at 1, 2, or 3 digit max for a year

You can reproduce the issue on any DateField example https://react-spectrum.adobe.com/react-aria/DateField.html

Here is a demo https://share.cleanshot.com/cT8SNXkD

### Version

latest

### What browsers are you seeing the problem on?

Chrome

### If other, please specify.

_No response_

### What operating system are you using?

mac

### 🧢 Your Company/Team

_No response_

### 🕷 Tracking Issue

_No response_