huggingface / huggingface/evaluate

It seems like evaluate.load doesnt use

Open
#561 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

It seems like `evaluate.load` doesnt use `cache_dir` to load local files at all.

I loaded the `squad` metric with internet and `cache_dir` argument used. And then tried again with out internet but `evaluate.load` encounter file `squad.py` not found error.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.