docling-project / docling-project/docling

Parenthesis leads to duplicated pieces of text over the parsed file

Open
#3,319 0 comments 0 reactions 0 assignees View on GitHub
question triage/close-stale
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
3d 4h
Merged PRs (30d)
95

Description

### Question

Found a weird behavior of PDF parser. After process a PDF file (cyrillic text) I can see a lot of pieces of text everywhere.
Looks like the parser replaced every parenthesis "(" by the piece of text taken from title page (contains some copyright info).
I'm so sorry for image in russian but it shows the issue:

Image

Finally, the orignal docoment is not so big, but the piece appears 159 times in the final text file (MD, JSON).
I'm not sure it is a bug or not. Of cource I can do some manual prapararations before processing the document. For example to remove the text from title page which is cause of the issue but I think it could be hard to process many documents.

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the report with a Cyrillic PDF in the PDF parser and inspect the generated Markdown and JSON for repeated title-page text after opening parentheses. Confirm whether the repetition occurs consistently, then trace the parser path responsible and verify that the duplicated text no longer appears in either output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.