magenta / magenta/mt3

how to finetune

Open
#170 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.8k
Forks
224
Avg merge
54m
Merged PRs (30d)
1

Description

hello, i read the colab and download the pretrain model from gs, i create my own data, and i add the code to datasets.py and tasks.py, but when i use the gin script to finetune the model, the error is that:
File "/root/miniconda3/envs/mt3/lib/python3.11/site-packages/t5x/checkpoints_utils.py", line 88, in get_step_from_checkpoint_dir
raise ValueError('Found improperly formatted checkpoint directory.')
ValueError: Found improperly formatted checkpoint directory.
In call to configurable 'train' ()

i guess because the gs pretrain model down flow the t5x train step, can you provide the suggest for me ? thank you !

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the fine-tuning gin script and the checkpoint path, then inspect t5x/checkpoints_utils.py at get_step_from_checkpoint_dir alongside the downloaded Google Cloud checkpoint directory. Review the custom changes in datasets.py and tasks.py only after confirming the checkpoint layout. Done means the checkpoint is accepted and the fine-tuning command proceeds past checkpoint loading.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.