google-research / google-research/t5x
Why is one_hot=True in network.py
Open
- Dominant language
- Python
- Stars
- 3k
- Forks
- 338
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
I am confused as to why one_hot=True in
From my understanding, this should increase the size of the matrix multiplication and reduce efficiency. Is this not correct?
Contributor guide
Assessment
This issue has not been assessed yet.