JuliaText / JuliaText/WordTokenizers.jl
Benchmark against Rust library
Open
- Dominant language
- Julia
- Stars
- 100
- Forks
- 25
- PR merge metrics
- No merged PRs in 30d
Description
We should benchmark agaisnt https://github.com/huggingface/tokenizers
I don't expect for us to win, but it gives us a line to target against.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.