InternLM / InternLM/lmdeploy

310P是否支持qwen2.5-vl

Open
#3,483 2 comments 0 reactions 1 assignee Claimed by @jinminxi104 View on GitHub
Dominant language
Python
Stars
8.1k
Forks
748
Avg merge
6d 2h
Merged PRs (30d)
54

Description

LMdeploy和dlinfer代码分别使用[DeepLink-org:support_310P](https://github.com/DeepLink-org/lmdeploy/tree/support_310P)和[yao-fengchen:support_310P](https://github.com/yao-fengchen/dlinfer/tree/support_310P)

运行如下代码:

``from lmdeploy import pipeline, PytorchEngineConfig
from lmdeploy.vl import load_image
if __name__ == "__main__":
pipe = pipeline('/root/Qwen2.5-VL-7B-Instruct',
backend_config=PytorchEngineConfig(tp=1, device_type='ascend', eager_mode=True))
image = load_image('https://raw.githubusercontent.com/open-mmlab/mmdeploy/main/tests/data/tiger.jpeg')
response = pipe(('describe this image', image))
print(response)
``

但是发生报错:

![Image](https://github.com/user-attachments/assets/0cbd3660-fcfb-41c1-8689-93d68a8f6c8a)
![Image](https://github.com/user-attachments/assets/111c64d6-94d0-41dc-914e-ed0738f8c359)
![Image](https://github.com/user-attachments/assets/f98bada0-16fd-4642-8420-2ed228c209a6)
![Image](https://github.com/user-attachments/assets/afd01cf6-8c6f-43dc-baf8-9748f06725a5)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.