deepset-ai / deepset-ai/haystack-core-integrations
Unstructured File Converter: maintenance and refactoring
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 203
- Forks
- 332
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 80
Description
This component was developed a while ago when the Unstructured ecosystem was smaller and simpler.
It evolved over time and now includes: the open-source library, free and paid APIs, API clients, the Docker image (for running the API locally).
TODO
Ensure compatibility withThis was magically fixed in #1841unstructured-client>=0.30.0(see #1416).- Evaluate whether we can remove the dependency on the
unstructuredlibrary. Initially, this was the only way to programmatically query self-hosted APIs, but we should explore if the client alone is sufficient. - Verify that our integration correctly works with APIs hosted by Unstructured (review URLs, etc...) or fix any issues.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Unstructured File Converter and reviewing its dependency declarations and uses of the Unstructured library and client. Check the existing API URL handling and determine whether hosted and self-hosted APIs work correctly. Done means the dependency question is resolved and any hosted-API issues are fixed or documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, backend-api-design
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100