fix: [PDF document with 81 pages being indexed into 1 node in Qdrant and Postgres, missing 99% of the document after "successfully indexed"]

Describe the bug

When trying the community version, after connecting successfully an Azure LLM, Qdrant connection, and Llamaparse connection, I have tested by uploading a single document and clicking "index". It shows that it has successfully indexed the document, but only with "1 node". Upon further investigating, the Qdrant vector db has only a single indexed node with only the first title page text of the document. No other parts of the document are indexed.

To reproduce

Using Azure LLM, llamaparse, and Qdrant, then uploading a PDF with chunk_size = 1024 and overlap = 128 then pressing index.

Expected behavior

I would expect to see thousands of nodes in my Qdrant vector db of the successfully parsed/split document.

Environment details

• Version: v0.101.6

Screenshots

Full log:

Parsing nodes: 100% 1/1:

Qdrant collection with 1 point:

EDIT:
Signed up for the unstract cloud free version, same issue there. It only indexes the first few characters of my document. I have checked that the llamaparse API works fine with my document.

Screenshot of the unstract cloud:

chunks used button:

Reproduce the issue with Azure LLM, Llamaparse, Qdrant, and Postgres using chunk_size 1024 and overlap 128. Start by comparing the Llamaparse output with the “Parsing nodes: 100% 1/1” log and the points stored in Qdrant. Done means the complete PDF is split and indexed rather than only its first page.