codertimo / codertimo/BERT-pytorch
Is it possible to train BERT?
Open
help wanted
question
- Dominant language
- Python
- Stars
- 6.5k
- Forks
- 1.3k
- PR merge metrics
- No merged PRs in 30d
Description
Is it possible to achieve the same result as the paper in short time?
Well.. I don't have enough GPU & computation power to see the enough result as google ai.
If we can't train the full corpus as the google, then how can we prove that this code is verified?
Training 256M size corpus without Google AI class gpu computation is nearly, impossible for me.
If you have any thought(reducing the model size) please let me know!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.