InternLM/lmdeploy

View on GitHub

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Stars: 8.1k
Forks: 751
Open beginner issues: 0
Indexed issues: 546
Avg merge: 6d 2h
Merged PRs (30d): 54

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 17, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

546 open issues indexed

[Feature] 请求支持qwen3-coder-next Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

InternLM/lmdeploy#4327 · 3 comments · 5 reactions · Opened Feb 5, 2026
[Bug] 昇腾310p部署InternVL3-8B，涉及图片回答报错No supported Ops kernel and engine are found for [ResizeD154], optype [ResizeD]. Open

InternLM/lmdeploy#4284 · 1 comment · 1 assignee · Opened Jan 21, 2026
[Feature] Support for RLM via REPL Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

InternLM/lmdeploy#4279 · Opened Jan 18, 2026
[Bug] double free or corruption (fasttop) Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

InternLM/lmdeploy#4266 · 5 comments · Opened Jan 12, 2026
[Feature] qwen3vl量化 Open

InternLM/lmdeploy#4239 · 3 comments · 1 assignee · Opened Dec 26, 2025
8*5060ti performance is low Open

InternLM/lmdeploy#4226 · 18 comments · 1 assignee · Opened Dec 19, 2025
[Feature] made api_server model-name case insensitive in request Open

InternLM/lmdeploy#4225 · 1 assignee · Opened Dec 19, 2025
[Feature] LLaDA 2.0 support Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#4211 · Opened Dec 14, 2025
[Bug] lmdeploy_dlinfer/ascend API Server流式输出问题 Open

InternLM/lmdeploy#4209 · 3 comments · 1 assignee · Opened Dec 12, 2025
[Bug] SDAR模型logprob Open

InternLM/lmdeploy#4206 · 1 comment · 1 assignee · Opened Dec 11, 2025
[Feature] 请求在 TurboMind 引擎中实现 InternVL3 和 Qwen2.5VL 的前缀缓存 (Prefix Caching) 功能 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

InternLM/lmdeploy#4205 · 1 reaction · Opened Dec 11, 2025
[Bug] torbomind和pytorch 推理qwen2.5 vl 7b 差距较大？ Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

InternLM/lmdeploy#4195 · 3 comments · Opened Dec 10, 2025
[Bug] crash when sleep but not wakeup in version 0.11.0 Open

InternLM/lmdeploy#4182 · 1 assignee · Opened Dec 4, 2025
[Feature] 使用v0.10.2版本和vllmv0.10.2镜像部署Llama2-7b|13B,tp=1对比差距很大,是应为是啥原因 Open

InternLM/lmdeploy#4174 · 6 comments · 1 assignee · Opened Dec 1, 2025
[Bug] 如何在910B4 A2 NPU 显卡上基于lmdeploy 部署 INTERNVL-38B, 量化模型,尝试很多方式，都是失败告终 Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

InternLM/lmdeploy#4169 · 9 comments · Opened Nov 28, 2025
[Bug] Does LMDeploy currently support loading LoRA adapters (single or multiple) for InternVL3 and Qwen2.5-VL models? Open

InternLM/lmdeploy#4162 · 1 assignee · Opened Nov 28, 2025
[Feature] Aarch64 Support Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#4146 · 3 comments · Opened Nov 23, 2025
在沐曦C500上部署InternVL2.5-26B模型失败 Open

InternLM/lmdeploy#4131 · 1 comment · 1 assignee · Opened Nov 18, 2025
hunyuan模型求支持！除了修改源码还有其他方法支持混元模型吗？ Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#4129 · 1 comment · Opened Nov 17, 2025
[Bug] qwen3-vl 在线服务启动报错 Error code: 400 - {'message': 'Logprobs or top_logprobs requested but not enabled logprobs_mode in engine configuration.', 'type': 'invalid_request_error', 'code': 400, 'param': None, 'object': 'error'} Open

InternLM/lmdeploy#4123 · 4 comments · 1 assignee · Opened Nov 13, 2025
[Feature] Qwen3-VL turbomind support Open

InternLM/lmdeploy#4122 · 9 comments · 1 assignee · Opened Nov 12, 2025
[Feature] 请求支持MolmoAct Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#4115 · Opened Nov 10, 2025
[Bug] 多模态模型pytorch后端TTFT时间比tubomind后端TTFT时间要长很多 Open

InternLM/lmdeploy#4114 · 1 reaction · 1 assignee · Opened Nov 10, 2025
[Bug] Qwen2.5-72B-Instruct-AWQ识图就报错 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

InternLM/lmdeploy#4113 · 1 comment · Opened Nov 10, 2025
[Feature] Ernie4.5支持 Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#4085 · 1 reaction · Opened Oct 30, 2025
[Feature] Can we support parameter n in OpenAI compatible API? Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

InternLM/lmdeploy#4073 · Opened Oct 24, 2025
[Feature] 请求支持qwen3-VL和deepseekOCR Open

InternLM/lmdeploy#4072 · 1 comment · 1 assignee · Opened Oct 24, 2025
是否支持多模态的多lora推理 Open

InternLM/lmdeploy#4067 · 2 comments · 1 assignee · Opened Oct 23, 2025
[Feature] lmdeploy支持多卡量化吗？ Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

InternLM/lmdeploy#4059 · Opened Oct 22, 2025
[Bug] 使用LMdeploy在v100推理 Qwen2.5-VL-32B 过一段时间就会卡住 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

InternLM/lmdeploy#4053 · 3 comments · Opened Oct 20, 2025
[Bug] SDAR模型推理 Open

InternLM/lmdeploy#4052 · 3 comments · 1 assignee · Opened Oct 20, 2025
[Bug] 沐曦C500推理报错 Open

InternLM/lmdeploy#4051 · 3 comments · 1 assignee · Opened Oct 20, 2025
[Feature] 请求支持MiniCPM-V 4.5 Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#4050 · Opened Oct 20, 2025
[Bug]version 0.10.1 : gpt-oss-20b and gpt-oss-120b model returns null message.content on API server Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

InternLM/lmdeploy#4049 · 3 comments · 1 reaction · Opened Oct 20, 2025
[Feature] 请求支持GLM-4.6 Open

InternLM/lmdeploy#4045 · 3 reactions · 1 assignee · Opened Oct 17, 2025
[Bug] 使用v0.10.1版本部署internvl2.5-38b-mpo-awq报错，如何解决？ Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

InternLM/lmdeploy#4040 · 1 comment · Opened Oct 15, 2025
[Bug] 多模型下输入图片提示没有ResizeD等操作，无法使用多模态，只能纯文本推理 Open

InternLM/lmdeploy#4038 · 1 assignee · Opened Oct 14, 2025
[Bug] AMD显卡运行出现错误 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

InternLM/lmdeploy#4022 · 4 comments · Opened Oct 3, 2025
[Feature] 使用lmdeploy里的pipeline推理可以关掉qwen3的推理模式吗 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

InternLM/lmdeploy#4010 · 9 comments · Opened Sep 26, 2025
[Docs] 支持量化压缩Intern-S1 和InternVL3_5-241B-A28B 吗? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

InternLM/lmdeploy#4009 · 2 comments · 1 reaction · Opened Sep 26, 2025
[Feature] DeepConf Support Open

InternLM/lmdeploy#4007 · 1 assignee · Opened Sep 25, 2025
[Bug] PyTorchEngine 性能分析没有保存文件 Open

InternLM/lmdeploy#3996 · 4 comments · 1 assignee · Opened Sep 19, 2025
[Bug] InternVL3_5-8B stuck during starting up with tp=2 Open

InternLM/lmdeploy#3993 · 1 assignee · Opened Sep 19, 2025
[Bug] InternVL3_5-8B failed with out of resource: shared memory, Required when tp=2 Open

InternLM/lmdeploy#3992 · 1 assignee · Opened Sep 19, 2025
[Bug] InternVL3-8B Quantization Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

InternLM/lmdeploy#3988 · 2 comments · 1 reaction · Opened Sep 18, 2025
多lora Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

InternLM/lmdeploy#3981 · 2 comments · Opened Sep 16, 2025
How to quantize Qwen2.5-VL 7B?(After Lora) Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

InternLM/lmdeploy#3979 · Opened Sep 16, 2025
Batch Inference Pipeline - Input/Output Sequence Handling and Prompt Failures guide Open

InternLM/lmdeploy#3972 · 1 assignee · Opened Sep 15, 2025
[Bug] 启用 --tool-call-parser qwen3 ，使用 claude code 报告错误 KeyError: 'content' Open

InternLM/lmdeploy#3967 · 1 comment · 1 assignee · Opened Sep 12, 2025
[Feature] Ling-mini-2.0 Support Open

backlog

Difficulty 5/5 Over a week Newbie friendliness 25/100

InternLM/lmdeploy#3966 · Opened Sep 12, 2025

InternLM/lmdeploy

Get new issues in your inbox