JacobLinCool / JacobLinCool/Textual-Data-Analysis

N-grams About English is Not Working as Expected

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

For example, the expected result of bigrams of "Happy New Year" is `["Happy New", "New Year"]`, however, the analyzer returns `["Ha", "ap", "pp", ...]`.

Although this package mainly targets to the CJK-like data, but it would be great if it's compatible with English texts too.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests. Start by locating the n-gram analyzer and its existing bigram behavior, then compare its output for "Happy New Year" with the expected word-based result; done means English bigrams produce ["Happy New", "New Year"] without breaking the package's CJK-oriented behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.