Implement a tool to calculate a BPE vocabulary
Open
enhancement
weighting
- Dominant language
- C++
- Stars
- 21
- Forks
- 26
- PR merge metrics
- No merged PRs in 30d
Description
A tool should be included in lttoolbox which calculates a BPE vocabulary as defined in this paper: https://arxiv.org/pdf/1508.07909.pdf
The idea is to use BPE to weight our morphological transducers.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.