Clicking outside the DatePicker can manipulate the focus of the DateSegment. (react-aria's DatePicker)

# 🐛 Bug Report

Clicking outside the DatePicker can manipulate the focus of the DateSegment.

react-spectrum's DatePicker does not cause this phenomenon.
Only react-aria's DatePicker.

## 🤔 Expected Behavior

Clicking outside of DatePicker does not focus or move focus.

## 😯 Current Behavior

[](https://gyazo.com/cb96c807a213f772de54af31f929fdf4)

## 💁 Possible Solution

## 🔦 Context

## 💻 Code Sample
https://react-spectrum.adobe.com/react-aria/useDatePicker.html#example

## 🌍 Your Environment

| Software | Version(s) |
| ---------------- | ---------- |
| @react-stately/datepicker | ~3.0.0-rc.0 |
| @react-aria/datepicker | ~3.0.0-rc.0 |
| Browser | Chrome |
| Operating System | macOS |

## 🧢 Your Company/Team

## 🕷 Tracking Issue (optional)