Extra blank space at the end of nonbreaking_prefix.en at end of line 103

Open
#85 7 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
1/5
Estimated time
Under an hour
Newbie friendliness
45/100
Issue type
Bug
Clarity
Clearly specified
Activity status
Stale
Domain
data

Research direction

Open nonbreaking_prefix.en and inspect the trailing blank at line 103. Remove the extra blank, then verify the example sentence keeps “No” together with the following period during sentence tokenization.

Written by the indexing model from the issue text.

Description

When testing sentence like:
1 Official Records of the General Assembly, Fifty-sixth Session, Supplement No. 21 .
'No' and the dot will be split apart. I check the nonbreaking_prefix.en and remove the blank at the end of line 103, it works as expected.

Dominant language
Python
Stars
1.8k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from nltk/nltk_data

All issues in nltk/nltk_data

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.