microsoft/Tokenizer
View on GitHubTypescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
- Stars
- 213
- Forks
- 37
- Open beginner issues
- 0
- Indexed issues
- 4
- Avg merge
- 5d 1h
- Merged PRs (30d)
- 5
- Dominant language
- C#
- License
- MIT
- Last GitHub push
- Sep 10, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- No beginner labels indexed
0 beginner-friendly issues open
Loading issues
No issues to show. Show everything we have indexed