bigscience-workshop / bigscience-workshop/biomedical
Manually specifying `data_dir` should override download URLs in dataloaders
Open
enhancement
- Dominant language
- Python
- Stars
- 505
- Forks
- 117
- PR merge metrics
- No merged PRs in 30d
Description
Sometimes it's more convenient to load files locally than to download them repeatedly (especially large files). If the `data_dir` argument is provided on instantiation, it should override the URL download and look in the appropriate location for the downloaded file.
Contributor guide
Assessment
This issue has not been assessed yet.