hlibbabii / hlibbabii/log-recommender

Consider words like naïve and Café as english

Open
#16 1 comment 0 reactions 0 assignees View on GitHub
dataprep
Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Currently all the words that contain non-asci chars are considered as non-English. However there are English words like naïve and Café that contain non-asci chars.

Possible solution is to remove accents.
E.g.
Café -> Café
Naïve -> naive

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the Python logic that classifies words containing non-ASCII characters as non-English and inspect how language checks are performed. Verify the behavior with “naïve” and “Café”; done means accented English words are accepted without incorrectly treating other non-English words as English.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.