JuliaText / JuliaText/WordTokenizers.jl

Sentence spliting of sentences with out whitespace after period

Open
#38 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Julia
Stars
100
Forks
25
PR merge metrics
No merged PRs in 30d

Description

`julia>WordTokenizers.split_sentences(" This is a sentence.Laugh Out Loud. Keep coding. No. Yes! True! ohh!ya! me too. ")`
`7-element Array{SubString{String},1}:`
`" This is a sentence.Laugh Out Loud."`
`"Keep coding."`
`"No."`
` "Yes!"`
` "True!"`
`"ohh!ya!"`
`"me too." `
I observed that the sentence which has no space after delimiter(Obviously that sentence grammatically incorrect) is not considered as two separate sentences(Like **.Laugh Out Loud. and Ohh!ya!**). Can this consider as an issue?

_Originally posted by @RohitPingale in https://github.com/JuliaText/WordTokenizers.jl/issues/32#issuecomment-541009127_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.