graykode / graykode/xlnet-Pytorch
position-wise feedforward only one linear layer?
Open
- Dominant language
- Jupyter Notebook
- Stars
- 581
- Forks
- 103
- PR merge metrics
- No merged PRs in 30d
Description
https://github.com/graykode/xlnet-Pytorch/blob/cb793a1c75bdc59e3360f04ec641af726719811f/xlnet.py#L163
In your implementation, the FFN module only has one linear layer. is it a bug?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.