Write design note: Explain how Linen manages RNGs
Open
Priority: P2 - no schedule
- Dominant language
- Jupyter Notebook
- Stars
- 7.3k
- Forks
- 833
- Avg merge
- 5h 11m
- Merged PRs (30d)
- 5
Description
Flax automatically splits RNGs for submodules by folding in the name of the submodule: https://github.com/google/flax/blob/master/flax/core/scope.py#L63
I couldn't find a place in the documentation where we explain this, but it seems quite useful to have it documented somewhere outside of `flax.core`.
Contributor guide
Assessment
This issue has not been assessed yet.