huggingface / huggingface/course
A small mistake in Chap6: BPE tokenization
Open
- Dominant language
- MDX
- Stars
- 4.2k
- Forks
- 1.4k
- Avg merge
- 13m
- Merged PRs (30d)
- 1
Description
There might be a small issue: in the example "thug", the given merge rules will first result in "u" and "g" being merged, but then it should be "h" and "ug", instead of "hu" and "g".
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.