deepset-ai / deepset-ai/haystack-core-integrations
Add run_async method for DeepEval Haystack Integration
@sjrl is already working on this.
Since Jul 30, 2026.
- Dominant language
- Python
- Stars
- 203
- Forks
- 332
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 80
Description
Is your feature request related to a problem? Please describe.
There are also many blocking requests to the LLM endpoints so having an run_async method will be beneficial. Evaluation is often very slow, and concurrency with regards to LLM requests will improve this.
Describe the solution you'd like
Add new run_async method to the DeepEvalEvaluator component that concurrent (using asyncio.gather) runs evaluation metrics.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.