bigscience-workshop / bigscience-workshop/Megatron-DeepSpeed

Set up a basic MLflow setup

Open
#87 1 comment 0 reactions 3 assignees Claimed by @JetRunner View on GitHub
MLFlow
Dominant language
Python
Stars
1.4k
Forks
226
PR merge metrics
No merged PRs in 30d

Description

Replicate all the tensorboard logging in Meg-DS, plus logging hyperparams of choice.
So on the code level:

1. repeat tensorboard 1:1 but log using mlflow api
2. find new places where to log new things (e.g. hyperparams)
3. WGs that want to log specific events/data will add those directly to Meg-DS code base
4. Currently the config is just `--mlflow-dir` on/off toggle which will log **all** MLFlow events/data

example:
https://gist.github.com/tsaoyu/14e39a6d246cb29b107a2cc62a12f7a3

**Blocking events:**

- [ ] @JetRunner setting up the MLFlow server

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.