Retry I/O operations on Windows

As you well know, write/delete operations are exclusive under Windows. It is quite common to run into PermissionErrors trying to delete a file that is being scanned (read) by an antivirus.

I ran into one such issue over at https://github.com/PyTorchLightning/pytorch-lightning/issues/9705 and the consensus seems to be that this should be handled by the filesystem libraries instead of peppering retry logic all over other projects.

To that end, is it possible to add options to I/O operation that require exclusivity (file/directory write/delete) that control how many times to retry the operation with some "reasonable" sleep between each attempt? Ideally the default should be that under Windows these operations retry by default so we don't have to retrofit all the python libraries in existence. Users who wish such operations to fail-fast can then set retries=0 to get the old behavior.

Thoughts?

No files, tests, or entry points are named. Start by reviewing the filesystem operation APIs and existing Windows-specific behavior, then determine which exclusive operations need configurable retries and how completion should be verified across platforms.