AI-Hypercomputer / AI-Hypercomputer/JetStream

Clean up Model Conversion Script

未关闭
#131 2 条评论 0 个 reaction 已指派 1 人 已被 @JoeZijunZhou 认领 在 GitHub 查看
主要语言
Python
星标
457
派生
67
PR 合并指标
30 天内没有已合并 PR

描述

Currently the model conversion script will [create a bucket](https://github.com/google/JetStream/blob/main/jetstream/tools/maxtext/model_ckpt_conversion.sh#L36) `export MODEL_BUCKET=gs://${USER}-maxtext`. However, it may be the case that the `gs://${USER}-maxtext` path already exists, which I imagine would break the script.

Solution: Be able to read in a few more arguments `MODEL_BUCKET` and `BASE_OUTPUT_DIRECTORY`. We should also delete references to `DATASET_PATH`.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。