michaelfeil / michaelfeil/infinity

support new model: jinaai/jina-reranker-m0

Open
#599 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.9k
Forks
206
PR merge metrics
No merged PRs in 30d

Description

### Model description

I tried to deploy the model, and got this error:

```
assert hasattr(
^^^^^^^^
AssertionError: AutoModel of jinaai/jina-reranker-m0 does not have get_text_features method

ERROR: Application startup failed. Exiting.
```

### Open source status & huggingface transformers.

- [x] The model implementation is available on transformers
- [x] The model weights are available on huggingface-hub
- [x] I verified that the model is currently not running in the latest version `pip install infinity_emb[all] --upgrade`
- [ ] I made the authors of the model aware that I want to use it with infinity_emb & check if they are aware of the issue.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing deployment of jinaai/jina-reranker-m0 with the latest infinity_emb[all] and inspect the model implementation available through transformers. Trace the startup assertion involving get_text_features; done means the model deploys successfully and supports reranking without that error.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
backend, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.