graykode / graykode/gpt-2-Pytorch
Discrepancy in Parameter Size of Smallest Model
Open
- Dominant language
- Python
- Stars
- 1k
- Forks
- 230
- PR merge metrics
- No merged PRs in 30d
Description
I have been using an implementation of GPT-2 from your repository and noticed that the size of the smallest GPT-2 model available in the repository differs from the smallest model mentioned in the original paper of GPT-2.
Specifically, the size of the parameters of the smallest model in the repository is about 124M but the smallest model in original paper is 117M
I am curious to know why there is this difference
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.