chengchingwen/BytePairEncoding.jl

Julia implementation of Byte Pair Encoding for NLP

Stars: 26
Forks: 5
Open beginner issues: 0
Indexed issues: 2

Dominant language: Julia
License: MIT
Last GitHub push: Jun 15, 2024
Latest indexed: Sep 14, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

2 open issues indexed

Help with ModernBert tokenizer (BPE+special tokens) Open

chengchingwen/BytePairEncoding.jl#8 · 16 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
`memhash` is to be deleted in 1.13 Open

chengchingwen/BytePairEncoding.jl#9 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

A short digest of beginner-friendly GitHub issues.