AI-Hypercomputer / AI-Hypercomputer/maxtext

Make maxtext_xpk_runner support other trainers

Aberta
#1,552 0 comentários 0 reações 2 responsáveis Reivindicada por @suexu1025 Ver no GitHub
feature request
Linguagem predominante
Python
Estrelas
2.4k
Forks
607
Merge médio
2d 19h
PRs com merge (30d)
158

Descrição

At the moment, the command is [hard coded](https://github.com/AI-Hypercomputer/maxtext/blob/1e4d513ad70dd4074d975a9f7936295008d4b900/benchmarks/maxtext_xpk_runner.py#L412C20-L412C33) to execute the `MaxText.train` module. If the module to execute could be configured in the WorkloadConfig, that would allow for additional trainers being developed to make use of the benchmark runner.

I am running into this while wanting to test a new trainer `MaxText.elastic_train` in PR #1310 but there are also other trainers being developed and merged and I think configuring `maxtext_xpk_runner` will be useful moving forward.

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.