Unstructured-IO / Unstructured-IO/unstructured-python-client
bug: pdf splitting modifies returned csv elements
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 119
- Forks
- 22
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 1
Description
Describe the bug
When specifying output_format as csv, the response from the api is different when split_pdf_page is True or False. When False, the elements contain an extra metadata field: text_as_html. This also means the element id does not match.
To Reproduce
_test_unstructured_client/integration/test_decorators.py::test_integration_split_csv_response illustrates this, but is passing because it asserts on a shortened string.
Expected behavior
The response to be identical whether or not split_pdf_page is True or False.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with _test_unstructured_client/integration/test_decorators.py::test_integration_split_csv_response and replace its shortened assertion with a comparison that exposes the extra text_as_html field and differing element id. Trace the CSV response handling for split_pdf_page=True and False; done means both responses are identical and the integration test checks the full result.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 62/100