docling-project / docling-project/docling

Adding Label Filters in Hybrid Chunking

Open
#667 2 comments 0 reactions 1 assignee Claimed by @vagenas View on GitHub
chunker enhancement triage/close-fixed
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
2d 21h
Merged PRs (30d)
84

Description

### Requested feature
I just started using Docling and I really like the results of the Hybrid Chunking mechanism (with merge_peers enabled) as it is able to effectively capture content that is separated across pages. However, I think it would be really useful if the chunking mechanism would have an additional parameter for ignoring specific texts like the page_footers and page_headers (this is currently captured and labelled as such by the models) while merging the content. I am attaching a screenshot of actual text and its parsed chunk for better clarity. Moreover, I am also adding an image showing the corresponding footer and header texts in the DoclingDocument.

![docling_hybrid_chunking_enhancement](https://github.com/user-attachments/assets/e76da879-6353-4730-afd8-249641c81a77)

![docling_texts_labels](https://github.com/user-attachments/assets/90425c1a-fe09-40b1-8343-5bb19f329bf4)

...

### Alternatives
I tried implementing this on my own by playing with the base Docling Document that was returned but I thought it would be a good feature to have as it would enable people to ignore repetitive content within a document.
...

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.