JuliaText/WordTokenizers.jl
View on GitHubHigh performance tokenizers for natural language processing and other related tasks
- Stars
- 100
- Forks
- 25
- Open beginner issues
- 0
- Indexed issues
- 7
- Dominant language
- Julia
- License
- No license data
- Last GitHub push
- Jan 17, 2021
- Latest indexed
- Sep 18, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
- PR merge metrics
- No merged PRs in 30d
-
`tokenize` API Open
JuliaText/WordTokenizers.jl#11 · 9 comments · 0 reactions · 0 assignees ·
-
JuliaText/WordTokenizers.jl#32 · 7 comments · 0 reactions · 0 assignees ·
-
JuliaText/WordTokenizers.jl#38 · 2 comments · 1 reaction · 0 assignees ·
-
JuliaText/WordTokenizers.jl#46 · 0 comments · 0 reactions · 0 assignees ·
-
JuliaText/WordTokenizers.jl#59 · 2 comments · 1 reaction · 0 assignees ·
-
JuliaText/WordTokenizers.jl#60 · 0 comments · 0 reactions · 0 assignees ·
-
JuliaText/WordTokenizers.jl#65 · 0 comments · 0 reactions · 0 assignees ·