deepset-ai / deepset-ai/haystack-core-integrations

Unstructured File Converter: maintenance and refactoring

Open
#1,417 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

integration:unstructured-fileconverter P3
Dominant language
Python
Stars
203
Forks
332
Avg merge
2d 4h
Merged PRs (30d)
80

Description

This component was developed a while ago when the Unstructured ecosystem was smaller and simpler.
It evolved over time and now includes: the open-source library, free and paid APIs, API clients, the Docker image (for running the API locally).

TODO
  • Ensure compatibility with unstructured-client>=0.30.0 (see #1416). This was magically fixed in #1841
  • Evaluate whether we can remove the dependency on the unstructured library. Initially, this was the only way to programmatically query self-hosted APIs, but we should explore if the client alone is sufficient.
  • Verify that our integration correctly works with APIs hosted by Unstructured (review URLs, etc...) or fix any issues.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the Unstructured File Converter and reviewing its dependency declarations and uses of the Unstructured library and client. Check the existing API URL handling and determine whether hosted and self-hosted APIs work correctly. Done means the dependency question is resolved and any hosted-API issues are fixed or documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, backend-api-design
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.