michaelfeil / michaelfeil/infinity

Feature : Support SPLADE pooling

Open
#399 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.9k
Forks
206
PR merge metrics
No merged PRs in 30d

Description

### Feature request

I want to run the `https://huggingface.co/prithivida/Splade_PP_en_v1` using infinity. While it loads the model, but the output isn't the sparse representation. It being a sparse embedding model, the huggingface Text Embedding Interface documentation says we need to set the `pooling` to `splade`. I am not sure if that solves the issue and will output sparse representation but the idea is to support sparse representation output.

### Motivation

Embedding support for hybrid retrieval, infinity already support Dense models, supporting Sparse model would make it more versatile and drop in tool for hybrid retrieval approach

### Your contribution

Went through previous issues but found nothing relevant

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing Infinity's model-loading and embedding-output path for the Hugging Face SPLADE model, then compare it with the Hugging Face Text Embedding Interface guidance for `pooling=splade`. Done means Infinity can return the model's sparse representation while preserving existing dense-model support.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.