bigscience-workshop / bigscience-workshop/lam

add guidance on adding files and a dataset script

Open
#40 1 comment 2 reactions 0 assignees View on GitHub
documentation
Dominant language
No language data
Stars
91
Forks
8
PR merge metrics
No merged PRs in 30d

Description

There are various times when you may want to upload files to the hub but have some more control over how the dataset is loaded via a dataset loading script. This can be relevant:
- when the original host may prefer not to have the additional traffic from downloads
- the original data is in a format that is not amenable to streaming/computational access or is very slow to process/load
- the dataset contains complex configuration options
- ??

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.