AI-Hypercomputer / AI-Hypercomputer/JetStream

Clean up Model Conversion Script

Abierto
#131 2 comentarios 0 reacciones 1 asignado Reclamado por @JoeZijunZhou Ver en GitHub
Lenguaje dominante
Python
Estrellas
457
Forks
67
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Currently the model conversion script will [create a bucket](https://github.com/google/JetStream/blob/main/jetstream/tools/maxtext/model_ckpt_conversion.sh#L36) `export MODEL_BUCKET=gs://${USER}-maxtext`. However, it may be the case that the `gs://${USER}-maxtext` path already exists, which I imagine would break the script.

Solution: Be able to read in a few more arguments `MODEL_BUCKET` and `BASE_OUTPUT_DIRECTORY`. We should also delete references to `DATASET_PATH`.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.