Support for new T5 tokenizer
Open
Feature
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 155
Description
### Feature Idea
Just a heads up that there's a new T5 + tokenizer out [here](https://github.com/Kaoru8/T5XXL-Unchained), which you may or may not want to officially implement support for.
### Existing Solutions
_No response_
### Other
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.