bytedance

bytedance/1d-tokenizer

View on GitHub

This repo contains the code for 1D tokenizer and generator

Stars
1.2k
Forks
70
Open beginner issues
0
Indexed issues
57
Dominant language
Jupyter Notebook
License
Apache-2.0
Last GitHub push
Mar 20, 2025
Latest indexed
Sep 14, 2026
Contributing guide
No contributing guide
Code of conduct
No code of conduct
Beginner labels
No beginner labels indexed
PR merge metrics
No merged PRs in 30d
57 open issues indexed Loading issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.