Why this `lr_decay_steps` is logged as `total num of iterations`
Open
question
- Dominant language
- Python
- Stars
- 17.9k
- Forks
- 4.5k
- Avg merge
- 4d 6h
- Merged PRs (30d)
- 271
Description
https://github.com/NVIDIA/Megatron-LM/blob/677382e46327d68ac96095ebcf97740b715df0cf/megatron/core/optimizer_param_scheduler.py#L268C58-L268C64
Contributor guide
Assessment
This issue has not been assessed yet.