google-deepmind / google-deepmind/deepmind-research
Layer normalization
Open
- Dominant language
- Jupyter Notebook
- Stars
- 15.2k
- Forks
- 2.9k
- PR merge metrics
- No merged PRs in 30d
Description
Thank you for sharing your good research findings.
I have a question about layer normalization in your network.
Unlike conventional cnn or transformer, one layer normalization is applied after going through several gcn.
Is there a special reason for applying it at the end of the encoder instead of applying it after each gcn layer?
Contributor guide
Assessment
This issue has not been assessed yet.