google-research / google-research/t5x

Fail to run pretrain from sample code

Open
#629 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
3k
Forks
338
PR merge metrics
No merged PRs in 30d

Description

Following this sample code:
https://github.com/google-research/t5x/blob/main/docs/usage/pretrain.md

I got this error:
ValueError: The version of the dataset you are trying to use (c4/en/2.2.0) is too old for this version of TFDS so cannot be generated.Either sync to a previous version of TFDS to first prepare the data or use another version of the dataset. Available for `download_and_prepare`: ['3.0.1']

Would it be possible to update the database reference?
https://github.com/google-research/text-to-text-transfer-transformer/blob/259358fab5dd8bf523234110b89c22b751174694/t5/data/tasks.py#L47

Contributor guide

Open the contributing guide

Research direction

Start with docs/usage/pretrain.md and inspect the referenced t5/data/tasks.py line to see where c4/en/2.2.0 is selected. Confirm the available TFDS version and update the dataset reference so the sample no longer requests the unavailable version, then verify the pretraining command progresses past dataset preparation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
data, machine-learning
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.