deepset-ai / deepset-ai/haystack
Add parallel component execution to Pipeline using a thread pool executor
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 26.6k
- Forks
- 3.2k
- Avg merge
- 1d 3h
- Merged PRs (30d)
- 194
Description
Similar to AsyncPipeline we could set up parallel component execution in Pipeline using a thread pool executor.
It could serve as a good performance boost for any users using the Pipeline class.
👋 Hello there! This issue will be handled internally and isn't open for external contributions. If you'd like to contribute, please take a look at issues labeled contributions welcome or good first issue. We'd really appreciate it!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue refers to Pipeline, AsyncPipeline, and a thread pool executor, but it names no files, tests, or entry points. It states that the work will be handled internally and is not open for external contributions, so there is no newcomer-ready completion path in the payload.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 10/100