docling-project / docling-project/docling

Converter seems to get stuck on very large pdfs

Open
#1,283 3 comments 19 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
2d 21h
Merged PRs (30d)
84

Description

### Bug
When trying to parse very large pdf files (such as [this one](https://dserver.bundestag.de/brd/2024/0350-24.pdf) with over 3000 pages, the converter seems to get stuck. For instance, a 300 page pdf with similar content may take anywhere from 10 to 20 minutes on my system, but the 3000+ page file above did not finish converting even after 8 hours.

### Steps to reproduce
```python
pipeline_options = PdfPipelineOptions()
pipeline_options.do_ocr = True
pipeline_options.do_table_structure = True
pipeline_options.table_structure_options.do_cell_matching = True

converter = DocumentConverter(
format_options={
InputFormat.PDF: PdfFormatOption(
pipeline_options=pipeline_options, backend=PyPdfiumDocumentBackend
)
}
)
converter.convert("https://dserver.bundestag.de/brd/2024/0350-24.pdf")

```
### Docling version
Docling version: 2.28.0
Docling Core version: 2.23.3
Docling IBM Models version: 3.4.1
Docling Parse version: 4.0.0
Python: cpython-312 (3.12.6)
Platform: Windows-11-10.0.26100-SP0

### Python version
Python 3.12.6

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.