keymanapp / keymanapp/keyman

feat(web): dictionary-based word breaking 🔬

Open
#5,025 10 comments 0 reactions 1 assignee Claimed by @jahorton View on GitHub
epic-dict-breaker feat web/ web/predictive-text/
Dominant language
Pascal
Stars
534
Forks
143
Avg merge
2d 10h
Merged PRs (30d)
113

Description

Predictive text: dictionary-based word-breaking (as in many SE Asia languages)

* The one I’ve given Makara so far is a hack that can definitely break.
* Definitely easier than attempting morphological modeling
* Potential lead: https://www.geeksforgeeks.org/word-break-problem-dp-32/
* It’s not that simple to import, given our sliding context window… but is definitely a great starting point.
* Other possible leads: just search “dictionary-based wordbreaking.”
* Marc has mentioned that ICU has existing implementation for a number of SE-Asian scripts. Especially for C; may not for JS.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.