tensorflow / tensorflow/datasets
Load only specific language in c4/multilingual
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
Currently c4/multilngual size is too big too load for the people who need only specific language
as probably mentioned in #2711 this
can we load only specific language ini tfds c4/multilingual ? say if i want load only italy language, i can just call
train_ds = tfds.load('c4/it')
or is it already possible to do that?
thanks
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the c4/multilingual entry point and read the discussion linked from issue #2711 to determine whether language-specific loading is already supported. Trace how language configurations are selected and identify the relevant tests, then verify that requesting one language loads only that language and that existing multilingual loading remains supported.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 28/100