dotnet / dotnet/machinelearning
xlm-Roberta tokenizer
Open
area-Tokenizers
enhancement
- Dominant language
- C#
- Stars
- 9.4k
- Forks
- 2k
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 11
Description
hey,
can you add support to xlm-Roberta tokenizer?
it's a very useful tokenizer that could be very helpful.
thank you!
Contributor guide
Assessment
This issue has not been assessed yet.