The Release 0.13 is not using the correct torch core version

🐛 Describe the bug

Currently the CI on branch release/0.13 is failing (I create dummy PR https://github.com/pytorch/vision/pull/6092 to track this).
We fail on type_check and this does not happen on main branch.
After looking at the error: https://app.circleci.com/pipelines/github/pytorch/vision/17906/workflows/8f008f5a-13b2-4207-a378-51ae705b99b7/jobs/1450718
especially on the installation of pytorch, we get:

#!/bin/bash -eo pipefail
pip install  --user  --progress-bar=off --pre torch --extra-index-url https://download.pytorch.org/whl/test/cpu/torch_test.html

Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/test/cpu/torch_test.html
Collecting torch
  Downloading torch-1.11.0-cp37-cp37m-manylinux1_x86_64.whl (750.6 MB)

We should use the RC branch 1.12 from pytorch core but instead we get version 1.11.

After digging a bit deeper, if we search "torch-" on https://download.pytorch.org/whl/test/cpu/torch_test.html currently I can only see 4 versions and the latest one is indeed 1.11. I think there is a problem here.

cc @malfet @seemethere @datumbox @atalman