google-research / google-research/language
REALM - Training data for pre-trained model
Open
- Dominant language
- Python
- Stars
- 1.8k
- Forks
- 362
- PR merge metrics
- No merged PRs in 30d
Description
In your [README](https://github.com/google-research/language/blob/master/language/realm/README.md) you say
_We are in the process of releasing the full pre-training corpus and retrieval corpus (Wikipedia) needed for pre-training REALM_
Is this still the plan? Maybe I missed a link to the data or a script.
Contributor guide
Assessment
This issue has not been assessed yet.