[Bug] 将InternVL2_5-26B-AWQ转换成turbomind之后使用turbomind引擎 部署 api请求图片解析,参数传递url与base64均报错-无法进行图片识别
- Dominant language
- Python
- Stars
- 8.1k
- Forks
- 748
- Avg merge
- 6d 2h
- Merged PRs (30d)
- 54
Description
### 将InternVL2_5-26B-AWQ转换成turbomind之后使用turbomind引擎 部署 api请求图片解析,参数传递url与base64均报错-无法进行图片识别 ,更换成AWQ格式使用pytorch引擎部署,服务可以正常识别参数
### 我已查看所有其他的Issues,未找到合适的解决办法
POSTMAN 请求结果:
### 参数1
```json
{
"model": "ai_img",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "描述一下这张图片"
},
{
"type": "image_url",
"image_url": {
"url": "https://raw.githubusercontent.com/open-mmlab/mmdeploy/main/tests/data/tiger.jpeg"
}
}
]
}
],
"temperature": 0.95,
"stream": false,
"n": 1
}
```
### 参数2
```json
{
"model": "ai_img",
"messages": [
{
"role": "user",
"content": [
{
"type": "text",
"text": "描述一下这张图片"
},
{
"type": "image_url",
"image_url": {
"url": "data:image/jpeg;base64,/9j/4AAQSkZJRgABAQEASA.........."
}
}
]
}
],
"temperature": 0.95,
"stream": false,
"n": 1
}
```
### 返回结果
```json
{
"id": "17",
"object": "chat.completion",
"created": 1740120663,
"model": "ai_img",
"choices": [
{
"index": 0,
"message": {
"role": "assistant",
"content": "很抱歉,我目前还无法进行图像识别,所以无法描述所提供的图片。如果您可以提供关于图片的详细描述或信息,我会很乐意帮助您进一步理解和分析。",
"tool_calls": null
},
"logprobs": null,
"finish_reason": "stop"
}
],
"usage": {
"prompt_tokens": 51,
"total_tokens": 89,
"completion_tokens": 38
}
}
```
### 部署版本
```Shell
lmdeploy 0.7.0
...
```
Contributor guide
Assessment
This issue has not been assessed yet.