AI-Hypercomputer / AI-Hypercomputer/maxtext
Make maxtext_xpk_runner support other trainers
Offen
#1,552
0 Kommentare
0 Reaktionen
2 zugewiesene Personen
Beansprucht von @suexu1025
Auf GitHub ansehen
feature request
- Vorherrschende Sprache
- Python
- Sterne
- 2.4k
- Forks
- 607
- Ø Merge
- 2 T. 19 Std.
- Gemergte PRs (30 T.)
- 158
Beschreibung
At the moment, the command is [hard coded](https://github.com/AI-Hypercomputer/maxtext/blob/1e4d513ad70dd4074d975a9f7936295008d4b900/benchmarks/maxtext_xpk_runner.py#L412C20-L412C33) to execute the `MaxText.train` module. If the module to execute could be configured in the WorkloadConfig, that would allow for additional trainers being developed to make use of the benchmark runner.
I am running into this while wanting to test a new trainer `MaxText.elastic_train` in PR #1310 but there are also other trainers being developed and merged and I think configuring `maxtext_xpk_runner` will be useful moving forward.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.