AI-Hypercomputer / AI-Hypercomputer/JetStream
Clean up Model Conversion Script
Offen
#131
2 Kommentare
0 Reaktionen
1 zugewiesene Person
Beansprucht von @JoeZijunZhou
Auf GitHub ansehen
- Vorherrschende Sprache
- Python
- Sterne
- 457
- Forks
- 67
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
Currently the model conversion script will [create a bucket](https://github.com/google/JetStream/blob/main/jetstream/tools/maxtext/model_ckpt_conversion.sh#L36) `export MODEL_BUCKET=gs://${USER}-maxtext`. However, it may be the case that the `gs://${USER}-maxtext` path already exists, which I imagine would break the script.
Solution: Be able to read in a few more arguments `MODEL_BUCKET` and `BASE_OUTPUT_DIRECTORY`. We should also delete references to `DATASET_PATH`.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.