PaddlePaddle/FastDeploy

View on GitHub

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Stars: 3.7k
Forks: 756
Open beginner issues: 0
Indexed issues: 246
Avg merge: 19h 28m
Merged PRs (30d): 4

Dominant language: Python
License: Apache-2.0
Last GitHub push: Aug 26, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

246 open issues indexed

单机8块P800运行Qwen3-235B-A22B总是loadlayers开始的时候崩溃， xpu_ipc_get_memhandle failed 。 Open

PaddlePaddle/FastDeploy#8102 · 1 assignee · Opened Jul 16, 2026
Unauthenticated pickle deserialization via ZMQ wildcard bind in splitwise P/D disaggregated serving Open

PaddlePaddle/FastDeploy#8100 · 1 assignee · Opened Jul 14, 2026
[BugFix][Metax] release/2.5: TypeError calling post_process with line_break_id kwarg Open

PaddlePaddle/FastDeploy#7940 · 1 assignee · Opened May 27, 2026
P800昆仑芯8卡模组环境，部署ERNIE-4.5-300B-A47B-FP8-Paddle模型报错 Open

PaddlePaddle/FastDeploy#7484 · 1 comment · 1 assignee · Opened Apr 19, 2026
天数 BI-150S 无法部署 PaddleOCR-VL Open

PaddlePaddle/FastDeploy#7461 · 1 assignee · Opened Apr 17, 2026
[Feature] 线性注意力 (Lightning/Linear Attention) 循环状态接入 ForwardMeta.caches 缓存管理体系 Open

PaddlePaddle/FastDeploy#7334 · 3 assignees · Opened Apr 10, 2026
基于arm+npu 的服务器，可以实现用 FastDeploy 部署 PaddleOCR-VL + TableMagic 这2条产线吗，主要为了解决越跑越慢的问题 Open

PaddlePaddle/FastDeploy#7291 · 2 comments · 1 assignee · Opened Apr 10, 2026
[Feature] 线性注意力 (Lightning/Linear Attention) 循环状态接入 ForwardMeta.caches 缓存管理体系 Open

PaddlePaddle/FastDeploy#7199 · 1 reaction · 3 assignees · Opened Apr 3, 2026
旧版在哪里呀 Open

PaddlePaddle/FastDeploy#7108 · 1 comment · 1 assignee · Opened Mar 31, 2026
[Iluvatar] wint8 量化推理报错 CUINFER_STATUS_BAD_PARAM，且 debug 需要全量编译，耗时太长 Open

PaddlePaddle/FastDeploy#7063 · 8 comments · 1 reaction · 1 assignee · Opened Mar 28, 2026
沐曦 Metax GPU 服务器上编译失败 Open

PaddlePaddle Hackathon

PaddlePaddle/FastDeploy#7059 · 6 comments · 2 assignees · Opened Mar 28, 2026
FastDeploy 1.x版本在30和40系列可以正常运行，在50系列无法正常运行。 Open

PaddlePaddle/FastDeploy#6925 · 12 comments · 1 assignee · Opened Mar 19, 2026
fastdeploy2.5支持编译C++库，对接paddleseg 进行推理么 Open

PaddlePaddle/FastDeploy#6605 · 2 comments · 1 assignee · Opened Mar 2, 2026
[AIStudio] Inference Request Stalls After Enabling logprobs Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

PaddlePaddle/FastDeploy#6508 · 4 comments · Opened Feb 25, 2026
好久没研究fastdeploy今天发现fastdeploy好像不支持目标检测模型部署了吗 Open

PaddlePaddle/FastDeploy#6344 · 1 comment · 1 assignee · Opened Feb 4, 2026
【热身打卡】FastDeploy 编译打卡 Open

PaddlePaddle/FastDeploy#6225 · 2 assignees · Opened Jan 26, 2026
PaddleOCR-VL runtime error: image_features is None in FastDeploy 2.4.0 Open

PaddlePaddle/FastDeploy#6179 · 7 comments · 1 assignee · Opened Jan 23, 2026
PaddleOCR-VL serving crashes with shape mismatch Open

PaddlePaddle/FastDeploy#6075 · 1 comment · 1 assignee · Opened Jan 16, 2026
EB5 Model 误导性报错 Open

PaddlePaddle/FastDeploy#5993 · 1 assignee · Opened Jan 12, 2026
FastDeploy对PaddlePaddle版本的依赖问题 Open

PaddlePaddle/FastDeploy#5990 · 3 comments · 1 assignee · Opened Jan 12, 2026
PaddleOCR-VL Serving with Data Parallel? Open

PaddlePaddle/FastDeploy#5973 · 3 comments · 2 assignees · Opened Jan 9, 2026
转换ch_PP-OCRv3模型到rknn报错！！ Open

PaddlePaddle/FastDeploy#5595 · 1 assignee · Opened Dec 16, 2025
PaddleOCR-VL 微调后的模型无法使用 FastDeploy 加载和推理 Open

PaddlePaddle/FastDeploy#5525 · 10 comments · 1 assignee · Opened Dec 12, 2025
天数 Iluvatar BI-V150显卡部署GLM-4.5-Air成功但调用失败 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#5507 · 3 comments · Opened Dec 11, 2025
PaddleOCR-VL-0.9B使用FastDeploy部署以后能否使用文档解析功能呢？ Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

PaddlePaddle/FastDeploy#5482 · 4 comments · Opened Dec 10, 2025
把这个 https://github.com/PaddlePaddle/FastDeploy/pull/5460 改动也给 release/2.4 提交一下 Open

PaddlePaddle/FastDeploy#5478 · 1 reaction · 1 assignee · Opened Dec 9, 2025
OSError: (External) CUDA error(719), unspecified launch failure. Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#5372 · 2 comments · Opened Dec 4, 2025
请问，什么时候可以支持Qwen3-VL模型部署? Open

Feature Request

PaddlePaddle/FastDeploy#5130 · 1 assignee · Opened Nov 19, 2025
Fastdeploy编译问题 Open

PaddlePaddle/FastDeploy#4978 · 2 comments · 1 assignee · Opened Nov 12, 2025
Fastdeploy编译问题 Open

PaddlePaddle/FastDeploy#4975 · 3 comments · 1 assignee · Opened Nov 12, 2025
请问ERNIE-4.5-VL-28B-A3B-Thinking模型是否支持量化 Open

PaddlePaddle/FastDeploy#4970 · 1 comment · 1 assignee · Opened Nov 12, 2025
FastDeploy部署PPOCRV4 Open

PaddlePaddle/FastDeploy#4862 · 3 comments · 1 assignee · Opened Nov 6, 2025
ERNIE 4.5-VL模型问题跟进 Open

PaddlePaddle/FastDeploy#4849 · 2 comments · 1 assignee · Opened Nov 6, 2025
[Deterministic Inference] Support Deterministic Inference Open

Deterministic

PaddlePaddle/FastDeploy#4651 · 1 reaction · 1 assignee · Opened Oct 29, 2025
昆仑芯P800推理RetinaNet模型报错 Open

PaddlePaddle/FastDeploy#4403 · 1 comment · 1 assignee · Opened Oct 14, 2025
昆仑芯-p800 复现错误 Open

PaddlePaddle/FastDeploy#4363 · 5 comments · 1 assignee · Opened Oct 11, 2025
【源码编译错误】nvcc error : 'cudafe++' died due to signal 9 (Kill signal) Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

PaddlePaddle/FastDeploy#4136 · 2 comments · Opened Sep 16, 2025
后续是否会提供其它模型的工具解析器？以及大概什么时候？ Open

Feature Request

Difficulty 5/5 Over a week Newbie friendliness 20/100

PaddlePaddle/FastDeploy#4124 · 3 comments · Opened Sep 16, 2025
请更新可用的installtion文档 Open

Difficulty 3/5 1-2 days Newbie friendliness 15/100

PaddlePaddle/FastDeploy#4122 · 2 comments · Opened Sep 16, 2025
C++ version with PP-OCR support Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

PaddlePaddle/FastDeploy#4048 · 3 comments · Opened Sep 10, 2025
FastDeploy完整启动代码， fastdeploy.entrypoints.openai.api_server Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#4019 · 5 comments · 1 reaction · Opened Sep 9, 2025
```gpu_memory_utilization```参数检查，如果用户配置超过0.95时，给出警告提示 Open

PaddlePaddle/FastDeploy#4016 · 1 reaction · 1 assignee · Opened Sep 9, 2025
新增entrypoints单测的开发 Open

PaddlePaddle/FastDeploy#3568 · 1 reaction · 1 assignee · Opened Aug 23, 2025
支持stop_token_ids参数 Open

Feature Request

PaddlePaddle/FastDeploy#3353 · 1 reaction · 2 assignees · Opened Aug 12, 2025
如何提高推理响应时间？ Open

PaddlePaddle/FastDeploy#3269 · 1 assignee · Opened Aug 8, 2025
Error not find reason Open

PaddlePaddle/FastDeploy#3238 · 1 assignee · Opened Aug 6, 2025
FastDeploy:2.0.3，发布DeepSeek-R1-Distill-Qwen-32B时，报错 Open

PaddlePaddle/FastDeploy#3237 · 1 assignee · Opened Aug 6, 2025
[feature reqeust] LogitsProcessor的支持 Open

Feature Request

PaddlePaddle/FastDeploy#3101 · 2 assignees · Opened Jul 30, 2025
[Feature Request] 在import fastdeploy时就会产生大量的日志文件 Open

PaddlePaddle/FastDeploy#3062 · 1 assignee · Opened Jul 29, 2025
[bug] 'CompletionOutput' object has no attribute 'tool_call_content' Open

PaddlePaddle/FastDeploy#2802 · 7 comments · 1 assignee · Opened Jul 10, 2025

PaddlePaddle/FastDeploy

Get new issues in your inbox