InternLM / InternLM/lmdeploy

[Feature] support Qwen3 Embedding and Reranker

Open
#3,679 1 comment 4 reactions 0 assignees View on GitHub
backlog
Dominant language
Python
Stars
8.1k
Forks
748
Avg merge
6d 2h
Merged PRs (30d)
54

Description

### Motivation
lmdeploy serve api_server /root/Qwen3-Embedding--model-name Qwen3-Embedding
run Qwen3 Embedding and Reranker ok

nomic-embed-text is not explicitly supported by lmdeploy.

### Related resources
/v1/embeddings
{
"message": "Unsupported by turbomind.",
"type": "invalid_request_error",
"code": 400,
"param": null,
"object": "error"
}

### Additional context
/v1/rerank Not Found

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.