google-deepmind / google-deepmind/sonnet

Is there any convenient way to do spectrum normalization? (Sonnet version: 2.0.0)

Open
#193 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
10k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

Dear Deepminder:

For generative adversarial network, there introduces a normalization called spectrum normalization (ref: https://arxiv.org/abs/1802.05957).

However I find according to the knowledge of me, it is a little hard for me to incorporate it into Sonnet.

This is because spectral normalization changes the weights. But I checked snt.Conv2D, seems the weight is intractable due to internal management.

Old version sonnet seems to have a solution,
(https://github.com/deepmind/sonnet/issues/99)
but I can't find "custom_getter" and other Solutions in Sonnet version: 2.0.0.

So could I be given some suggestion regarding such a situation?
Thanks a lot.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.