googleapis / googleapis/python-aiplatform

Support Text summary in Experiment TensorBoard

Aperta
#6,338 2 commenti 1 reazione 0 assegnatari Vedi su GitHub
api: vertex-ai
Lingua principale
Python
Stelle
905
Fork
465
Merge medio
1g 13h
PR unite (30g)
44

Descrizione

Hello,

I'm migrating some ML tasks to Vertex AI and really like the Experiment framework.

My current setup is:
- submitting CustomJob tasks from a custom training image
- group these tasks in an Experiment, to enable an easy comparison between those
- the training script is adapted to log information both to Experiment (with the Python SDK, e.g. `log_time_series_metrics()`) and to the CustomJob TB (standard SummaryWriter in the `AIP_TENSORBOARD_LOG_DIR`), following the documentation

It's all very convenient, but there is one thing I cannot do with Experiment.
The Python SDK does not support text uploads (and hparams but that's not crucial), and it's very important for NLP or ASR training tasks.
This is how it looks like in my CustomJob TB:

Image

I'm opening this feature request as this would be a handsome addition to the Experiment framework.

Thank you for your work, don't hesitate if I can provide more input.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.