how to finetune
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.8k
- Forks
- 224
- Avg merge
- 54m
- Merged PRs (30d)
- 1
Description
hello, i read the colab and download the pretrain model from gs, i create my own data, and i add the code to datasets.py and tasks.py, but when i use the gin script to finetune the model, the error is that:
File "/root/miniconda3/envs/mt3/lib/python3.11/site-packages/t5x/checkpoints_utils.py", line 88, in get_step_from_checkpoint_dir
raise ValueError('Found improperly formatted checkpoint directory.')
ValueError: Found improperly formatted checkpoint directory.
In call to configurable 'train' ()
i guess because the gs pretrain model down flow the t5x train step, can you provide the suggest for me ? thank you !
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the fine-tuning gin script and the checkpoint path, then inspect t5x/checkpoints_utils.py at get_step_from_checkpoint_dir alongside the downloaded Google Cloud checkpoint directory. Review the custom changes in datasets.py and tasks.py only after confirming the checkpoint layout. Done means the checkpoint is accepted and the fine-tuning command proceeds past checkpoint loading.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100