feyninc/tokie
View on GitHub🍡 30x faster tokenization for every HuggingFace model
- Stars
- 52
- Forks
- 5
- Open beginner issues
- 0
- Indexed issues
- 3
- Avg merge
- 1m
- Merged PRs (30d)
- 2
- Dominant language
- Rust
- License
- Apache-2.0
- Last GitHub push
- Aug 27, 2026
- Latest indexed
- Sep 15, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed