docling-project / docling-project/docling

Pickling docling docling_parse.pdf_parsers.pdf_parser_v2

Open
#1,892 1 comment 0 reactions 0 assignees View on GitHub
enhancement triage/close-stale
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
3d 4h
Merged PRs (30d)
95

Description

### Requested feature

...

It would be nice to pickle the objects, then we can jsut save them and load them when preprocessing instead of preprocessing everytime.
conv_res = doc_converter.convert(abs_file_path)

Contributor guide

Open the contributing guide

Research direction

Start with the docling_parse.pdf_parsers.pdf_parser_v2 code reached by doc_converter.convert(abs_file_path), and trace which objects are produced during preprocessing. Clarify the serialization and reload lifecycle before changing it; the work is done when the relevant objects can be pickled, saved, loaded, and reused instead of preprocessing every time.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.