google-deepmind / google-deepmind/limit

ValueError: SentenceTransformer.encode() has been called with additional keyword arguments that this model does not use: ['request_qid']

Open
#8 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
669
Forks
55
PR merge metrics
No merged PRs in 30d

Description

Faithfully used the `requirements.txt` file for installation, namely,

`git+https://github.com/embeddings-benchmark/mteb.git@w_limit`

It installed

```
>>> import mteb
>>> mteb.__version__
'1.38.34'
```

However get this error

`ValueError: SentenceTransformer.encode() has been called with additional keyword arguments that this model does not use: ['request_qid']. As per SentenceTransformer.get_model_kwargs(), this model does not accept any additional keyword arguments.`

I'm trying to run [this Evaluation code](https://github.com/google-deepmind/limit/tree/main?tab=readme-ov-file#evaluation).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.