[BUG] Failed downloads / 429 rate limiting for concurrent evaluations sharing cache

## Describe the bug
When running many evals in parallel, we are seeing rate limit throttling from Huggingface (429 errors). Digging in, it appears that despite the `~/.cache/huggingface` cache directory generally containing all of our cached datasets, but traffic is still being sent to Huggingface servers, resulting in throttling and throttling-related failures.

## To Reproduce
Execute numerous lighteval task evals across multiple tasks (e.g. all of MMLU) for multiple workers on the same IP (e.g. 1-GPU eval jobs sharing the same 8-GPU node) while sharing the underlying cache directory across eval jobs.

## Expected behavior
I would expect that once a dataset is locally available in the cache directory, `lighteval` would load the cached data in such a way as to never send traffic to Huggingface's servers.

## Version info
Please provide your operating system, lighteval version or commit if you installed from main, and pip/conda environment if your problem concerns dependencies.

OS: Ubuntu 20.04.6 LTS

pip environment:
```
absl-py==2.3.0
accelerate==1.7.0
aenum==3.1.15
aiobotocore==2.22.0
aiohappyeyeballs==2.6.1
aiohttp==3.12.4
aioitertools==0.12.0
aiosignal==1.3.2
annotated-types==0.7.0
antlr4-python3-runtime==4.13.2
anyio==4.9.0
attrs==25.3.0
blis==0.7.11
boto3==1.37.3
botocore==1.37.3
catalogue==2.0.10
certifi==2025.4.26
chardet==5.2.0
charset-normalizer==3.4.2
click==8.2.1
cloudpathlib==0.16.0
colorama==0.4.6
colorlog==6.9.0
confection==0.1.5
cymem==2.0.11
dataproperty==1.1.0
datasets==3.6.0
dill==0.3.8
docker-pycreds==0.4.0
docstring-parser==0.16
fasteners==0.19
filelock==3.18.0
frozenlist==1.6.0
fsspec==2025.3.0
gitdb==4.0.12
gitpython==3.1.44
h11==0.16.0
hf-xet==1.1.2
httpcore==1.0.9
httpx==0.27.2
huggingface-hub==0.32.2
idna==3.10
importlib-resources==6.5.2
iniconfig==2.1.0
jinja2==3.1.6
jmespath==1.0.1
joblib==1.5.1
jsonargparse==4.40.0
langcodes==3.5.0
language-data==1.3.0
latex2sympy2-extended==1.0.6
lighteval==0.10.0
lightning==2.5.1.post0
lightning-utilities==0.14.3
litdata==0.2.48
litgpt==0.5.8
lxml==5.4.0
marisa-trie==1.2.1
markdown-it-py==3.0.0
markupsafe==3.0.2
mbstrdecoder==1.1.4
mdurl==0.1.2
more-itertools==10.7.0
mpmath==1.3.0
multidict==6.4.4
multiprocess==0.70.16
murmurhash==1.0.12
networkx==3.5
nltk==3.9.1
numpy==1.26.4
nvidia-cublas-cu12==12.4.5.8
nvidia-cuda-cupti-cu12==12.4.127
nvidia-cuda-nvrtc-cu12==12.4.127
nvidia-cuda-runtime-cu12==12.4.127
nvidia-cudnn-cu12==9.1.0.70
nvidia-cufft-cu12==11.2.1.3
nvidia-curand-cu12==10.3.5.147
nvidia-cusolver-cu12==11.6.1.9
nvidia-cusparse-cu12==12.3.1.170
nvidia-cusparselt-cu12==0.6.2
nvidia-nccl-cu12==2.21.5
nvidia-nvjitlink-cu12==12.4.127
nvidia-nvtx-cu12==12.4.127
omegaconf==2.0.6
packaging==24.2
pandas==2.2.3
pathvalidate==3.2.3
pillow==11.2.1
platformdirs==4.3.8
pluggy==1.6.0
portalocker==3.1.1
preshed==3.0.9
propcache==0.3.1
protobuf==4.25.8
psutil==7.0.0
pyarrow==20.0.0
pycountry==24.6.1
pydantic==2.11.5
pydantic-core==2.33.2
pygments==2.19.1
pytablewriter==1.2.1
pytest==8.3.5
python-dateutil==2.9.0.post0
pytorch-lightning==2.5.1.post0
pytz==2025.2
pyyaml==6.0.2
regex==2024.11.6
requests==2.32.3
rich==14.0.0
rouge-score==0.1.2
s3fs==2025.3.0
s3transfer==0.11.3
sacrebleu==2.5.1
safetensors==0.5.3
scikit-learn==1.6.1
scipy==1.15.3
sentencepiece==0.2.0
sentry-sdk==2.29.1
setproctitle==1.3.6
setuptools==80.9.0
shellingham==1.5.4
six==1.17.0
smart-open==6.4.0
smmap==5.0.2
sniffio==1.3.1
spacy==3.7.2
spacy-legacy==3.0.12
spacy-loggers==1.0.5
srsly==2.5.1
sympy==1.13.1
tabledata==1.3.4
tabulate==0.9.0
tcolorpy==0.1.7
tenacity==9.1.2
termcolor==2.3.0
thinc==8.2.5
threadpoolctl==3.6.0
tifffile==2025.5.26
tokenizers==0.21.1
torch==2.6.0+cu124
torchao==0.11.0
torchmetrics==1.7.2
torchvision==0.21.0
tqdm==4.67.1
transformers==4.52.3
triton==3.2.0
typepy==1.3.4
typer==0.16.0
typeshed-client==2.7.0
typing-extensions==4.13.2
typing-inspection==0.4.1
tzdata==2025.2
urllib3==2.4.0
wandb==0.19.11
wasabi==1.1.3
weasel==0.3.4
wrapt==1.17.2
xxhash==3.5.0
yarl==1.20.0
zstd==1.5.7.0
```