Choosing Max Learning Rate for 1cycle Scheduling
未关闭
- 主要语言
- Jupyter Notebook
- 星标
- 30k
- 派生
- 13.1k
- PR 合并指标
- 30 天内没有已合并 PR
描述
In the book, the author states that we choose the max learning rate for the 1cycle scheduling the same way as we choose the optimal learning rate i.e The optimal learning rate is a bit lower than the point at which the loss starts to shoot up(about `10` times lower).

This is the curve for the CIFAR10 dataset From Exercise 8f, the max rate is chosen to be `0.05`, Shoudnt it be `0.02` or less since the loss shoots back up at `0.2 `or the like? Or is it just a matter of tuning
Thanks
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。