docling-project / docling-project/docling

No chunks returned because of "No content extracted"

Open
#2,566 2 comments 0 reactions 0 assignees View on GitHub
bug chunker html triage/close-stale
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
2d 21h
Merged PRs (30d)
84

Description

### Bug

While giving a particular URL to v1/chunk/hybrid/source/async i receive this:

```
"chunks": [],
"documents": [
{
"kind": "ExportResult",
"content": {
"filename": "example",
"md_content": null,
"json_content": {
"schema_name": "DoclingDocument",
"version": "1.7.0",
"name": "example",
"origin": {
"mimetype": "text/html",
"binary_hash": 545364923*****,
"filename": "example",
"uri": null
},
"furniture": {
"self_ref": "#/furniture",
"parent": null,
"children": [],
"content_layer": "furniture",
"name": "_root_",
"label": "unspecified"
},
"body": {
"self_ref": "#/body",
"parent": null,
"children": [
{
"$ref": "#/texts/0"
},
{
"$ref": "#/texts/1"
},
{
"$ref": "#/texts/2"
},
{
"$ref": "#/texts/3"
},
{ .....
```
Unfortunately because of privacy reasons i can't give you the url but i'll do my best to describe and give snippets of the code.

docling in the documents returns the whole content of the page and all the text in it so it's not a javacript rendering problem. it's a pretty long page but even when setting a very high max_token param i still get the same issue.

The html of the page contains a very long list of elements, here is an example:

```
Rent this service


  • Rent this service

  • Rent this service

  • Rent this service

  • Rent this service

  • Rent this service

  • Rent this service

  • Rent this service

  • Rent this service

  • Rent this service
  • LoremIpsum LoremIpsum


    LoremIpsum LoremIpsum

    ```

    i suppose the issue is due to the fact the it should create a very big amount of small chunks because each one of this lines has very few words but the information is still valuable.

    ### Steps to reproduce

    Calling v1/chunk/hybrid/source/async with the incriminated url or also giving the html file of that page.

    ### Docling version

    v1.5.1
    OAS 3.1.0

    ### Python version

    No python used, only api endpoints for the image hosted on ghr

  • Contributor guide

    Open the contributing guide

    Assessment

    This issue has not been assessed yet.

    Get new issues in your inbox

    A short digest of beginner-friendly GitHub issues.