michaelfeil / michaelfeil/infinity

How does this compare to Huggingface's Text Embedding Inference?

Open
#108 12 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.9k
Forks
206
PR merge metrics
No merged PRs in 30d

Description

Hi,

Thank you for your amazing work!

We'd like to add an embedding template for users to deploy on RunPod, and we're deciding between Infinity and [HF's Text Embedding Inference](https://github.com/huggingface/text-embeddings-inference/tree/main). How would you say Infinity compares, especially in performance?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the Infinity project and the linked Hugging Face Text Embedding Inference repository, then compare their serving capabilities and performance for the proposed RunPod embedding template. Done means documenting a clear comparison that helps choose between Infinity and Text Embedding Inference.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, backend
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.