google-research / google-research/t5x
Encoder-only T5
Open
- Dominant language
- Python
- Stars
- 3k
- Forks
- 338
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
Thanks for the great work!
Just a quick question: I'm looking to replicate the results of the [EncT5](https://arxiv.org/pdf/2110.08426.pdf) paper and was wondering if this repo could be useful. Is there an easy way to extract (and finetune) an encoder-only T5 model using your implementation? If not, is this something on your roadmap?
Contributor guide
Assessment
This issue has not been assessed yet.