modelscope / modelscope/ms-swift

在调用reranker的vllm部署的openai 接口时,如何同时传如多组query/doc?

Open
#7,179 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

stale
Dominant language
Python
Stars
15.7k
Forks
1.7k
Avg merge
1d 16h
Merged PRs (30d)
136

Description

目前我看到给的example里只涉及到单个pairs

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting the reranker vLLM OpenAI interface and the example mentioned in the issue. Determine whether the interface already accepts multiple query/document pairs, then document the supported request shape or clarify the limitation in the example; done means users can tell how to submit multiple pairs.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, machine-learning
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.