deepset-ai / deepset-ai/haystack

Make pipelines less complex

Open
#10,495 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

epic
Dominant language
Python
Stars
26.6k
Forks
3.2k
Avg merge
1d 3h
Merged PRs (30d)
194

Description

We want to make building pipelines in Haystack easier and want to reduce the number of components in pipelines to make them concise and easier to read.
Examples:

  • Add more super components so that users require fewer components for their pipelines
  • Consider moving super components to a separate repo or to it's own folder
  • Extend default (de-)serialization logic of custom components so that creating a custom component is less effort for users

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are identified in the issue. Begin by surveying existing super components and the default custom-component serialization logic, then determine whether the work should reduce pipeline components, reorganize super components, or simplify serialization. Done means a concrete, agreed scope with tests or examples showing simpler pipelines or easier custom-component creation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, developer-experience
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.