AI-Hypercomputer / AI-Hypercomputer/maxtext
Make maxtext_xpk_runner support other trainers
- Ngôn ngữ chính
- Python
- Star
- 2.4k
- Fork
- 607
- Merge trung bình
- 2 ngày 19 giờ
- Pull request đã merge (30 ngày)
- 158
Mô tả
At the moment, the command is [hard coded](https://github.com/AI-Hypercomputer/maxtext/blob/1e4d513ad70dd4074d975a9f7936295008d4b900/benchmarks/maxtext_xpk_runner.py#L412C20-L412C33) to execute the `MaxText.train` module. If the module to execute could be configured in the WorkloadConfig, that would allow for additional trainers being developed to make use of the benchmark runner.
I am running into this while wanting to test a new trainer `MaxText.elastic_train` in PR #1310 but there are also other trainers being developed and merged and I think configuring `maxtext_xpk_runner` will be useful moving forward.
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.