google-deepmind / google-deepmind/deepmind-research

Is the adaptive gradient clipping also applicable to layer normalization?

Open
#172 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
15.2k
Forks
2.9k
No merged PRs in 30d

Description

Hi,
My question is as the title.
Thanks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.