docling-project / docling-project/docling

[Bee] add content to word_cells when "PyPdfiumDocumentBackend" is used in PDF pipeline

Open
#3,370 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
2d 21h
Merged PRs (30d)
84

Description

### Requested feature
In order to have better PDF processing performance, **PyPdfiumDocumentBackend** is used to do the parsing, which is much faster than **doclingparseV4backend**. However, PyPdfiumDocumentBackend explicitly sets word_cells = [] and has_words = False, only textline_cells includes the content, which is line-based. I checked with Duso, and it said it is by design. But WDU team needs the single-world-based token generation in the final output. So this feature is requested.
...

### Alternatives
pdfium2 provides the character text and bbox, could docling generate word_cells based on it?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.