InternLM / InternLM/InternLM-XComposer
[Implementation details] layer wise learning rate decay.
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
In the paper, you mention learning rate decay is important. I would like to know how could I set layer decay in the code. Do you have plans to release the code of learning rate decay.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.