docling-project / docling-project/docling-parse
Word cell sometimes contains multiple words
- Dominant language
- C++
- Stars
- 333
- Forks
- 80
- Avg merge
- 1d 14h
- Merged PRs (30d)
- 10
Description
I have words in a line being combined together into a single word box by pdf_sanitator::create_word_cells
The space between the end of one word and the next is < space_width_factor_for_merge so the word box contains multiple words.
Should a space character trigger a word regardless of the character box distances? i.e. rather than remove all space chars (pdf_sanitator::create_word_cells (https://github.com/docling-project/docling-parse/blob/main/src/v2/pdf_sanitators/cells.h Line 136)) should they not be used as a marker to prevent merging.
```
// remove all spaces
auto itr = word_cells.begin();
while(itr!=word_cells.end())
{
if(utils::string::is_space(itr->text))
{
itr = word_cells.erase(itr);
}
else
{
itr++;
}
}
```
I'm currently having to post process the word boxes to check if it overlaps with ' ' box and break the word box up.
Contributor guide
Assessment
This issue has not been assessed yet.