deepset-ai / deepset-ai/haystack
Support gRPC interface of TEI
Open
Nobody has claimed this yet.
P2
- Dominant language
- Python
- Stars
- 26.6k
- Forks
- 3.2k
- Avg merge
- 1d 3h
- Merged PRs (30d)
- 194
Description
The gRPC interface of HuggingFace's Text Embeddings Inference (TEI) library is much, much faster than its HTTP interface. It would be fantastic to see Haystack add support for it.
https://github.com/huggingface/text-embeddings-inference?tab=readme-ov-file#grpc
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked Hugging Face Text Embeddings Inference gRPC documentation and then locate Haystack’s existing TEI integration. Determine the expected gRPC support and verify that the completed work can use the TEI gRPC interface rather than only its HTTP interface.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- grpc, python
- Domain
- ai, api
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100