PaddlePaddle/FastDeploy

View on GitHub

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

Stars: 3.7k
Forks: 756
Open beginner issues: 0
Indexed issues: 246
Avg merge: 19h 28m
Merged PRs (30d): 4

Dominant language: Python
License: Apache-2.0
Last GitHub push: Aug 26, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

246 open issues indexed

[bug] 'LLMEngine' object has no attribute '_get_generated_tokens' Open

PaddlePaddle/FastDeploy#2795 · 2 comments · 1 assignee · Opened Jul 10, 2025
[Feature Request] Support v1/models interface to view all the deploying models Open

Feature Request

PaddlePaddle/FastDeploy#2764 · 1 comment · 1 assignee · Opened Jul 9, 2025
8卡 h200 部署ERNIE-4.5-VL-424B-A47B-Paddle 失败 Open

ERNIE-45-VL

Difficulty 5/5 Over a week Newbie friendliness 20/100

PaddlePaddle/FastDeploy#2683 · 4 comments · Opened Jul 2, 2025
How to deploy ERNIE-4.5-300B-A47B-Paddle on 16 GPUs Open

PaddlePaddle/FastDeploy#2649 · 5 comments · 1 assignee · Opened Jun 30, 2025
some bugs when enable LLama2-7b with PaddleNLP Open

PaddlePaddle/FastDeploy#2627 · 1 assignee · Opened Jun 18, 2025
PP-SHITU 错误 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2619 · 2 comments · Opened May 27, 2025
orin nx 使用tensorrt推理报错 Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

PaddlePaddle/FastDeploy#2618 · Opened May 21, 2025
ValueError: Unknow elem_type for softmax_2.tmp_0! Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2617 · 1 comment · Opened May 13, 2025
Fastdeploy_python初始化cls_model为None之后，推理图片还是会先检测后进行方向旋转然后给识别模型进行识别 Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

PaddlePaddle/FastDeploy#2616 · 1 comment · Opened Apr 29, 2025
按教程部署完insightface后发现只能使用cpu Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2610 · Opened Apr 10, 2025
RK3588 OCR 内存泄露 Open

Difficulty 4/5 3-5 days Newbie friendliness 28/100

PaddlePaddle/FastDeploy#2609 · Opened Apr 9, 2025
请问如果在rk3576芯片上要怎么部署paddleocr模型？ Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

PaddlePaddle/FastDeploy#2608 · 1 reaction · Opened Apr 8, 2025
小程序替换模型失败 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2604 · 2 comments · Opened Mar 28, 2025
dynamic_batching 怎么设置呢 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2603 · Opened Mar 26, 2025
在NVIDIA 50系列显卡上使用fastdeploy Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2601 · 3 comments · Opened Mar 17, 2025
aarch64 RK3588 无法部署fastdeploy1.0.3以上版本 Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

PaddlePaddle/FastDeploy#2600 · 2 comments · Opened Mar 13, 2025
fastdeploy服务化部署mask输出mask值全为0 Open

Difficulty 4/5 3-5 days Newbie friendliness 32/100

PaddlePaddle/FastDeploy#2599 · Opened Mar 13, 2025
paddledetection使用ppyoloe导出的模型无法正常使用 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2598 · 1 comment · Opened Mar 12, 2025
RKYolo 预测推理耗时不断增加 Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

PaddlePaddle/FastDeploy#2596 · Opened Mar 10, 2025
编译fastdeploy中FastDeploy/fastdeploy /function/tranpose.cc 文件编译耗时特别多 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2595 · Opened Feb 26, 2025
瑞芯微RK3588板子问题 Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

PaddlePaddle/FastDeploy#2591 · Opened Feb 7, 2025
mask_rtdetr 模型部署，希望能尽快支持呢？或者有教程吗？ Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

PaddlePaddle/FastDeploy#2587 · Opened Jan 16, 2025
UNAVAILABLE: Invalid argument: unexpected inference input 'sigmoid_0.tmp_0', allowed inputs are: save_infer_model/scale_0.tmp_0 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2582 · Opened Dec 30, 2024
AI快车道-FastDeploy推理部署套件系列直播课里的文档无法下载 Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2581 · 1 comment · Opened Dec 27, 2024
npu 编译后无法使用 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2580 · 1 comment · Opened Dec 26, 2024
请问paddle.js还在维护吗？ Open

Difficulty 1/5 Under an hour Newbie friendliness 10/100

PaddlePaddle/FastDeploy#2579 · Opened Dec 26, 2024
可以部署到高通SNPE框架吗？在高通DSP上面可以跑吗？ Open

Difficulty 5/5 Over a week Newbie friendliness 18/100

PaddlePaddle/FastDeploy#2578 · Opened Dec 26, 2024
OCR的REC模型,能用RCNN的吗,比如rec_r50_fpn_srn Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

PaddlePaddle/FastDeploy#2575 · Opened Dec 17, 2024
PP-OCRv4 在没检测到文本的时候，结果出错 Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2574 · Opened Dec 13, 2024
C++SDK如何关闭日志啊 Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

PaddlePaddle/FastDeploy#2572 · 1 comment · Opened Dec 11, 2024
FastDeploy对AMD GPU / 海光DCU的支持问题 Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

PaddlePaddle/FastDeploy#2568 · Opened Nov 29, 2024
咨询：fd是否支持pp-yoloe-r旋转框检测？ Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

PaddlePaddle/FastDeploy#2565 · Opened Nov 22, 2024
开启paddlelite支持在aarch64架构上编译不成功 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

PaddlePaddle/FastDeploy#2556 · Opened Nov 16, 2024
华为昇腾310p编译安装出现CANN版本不匹配的问题 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2550 · 5 comments · Opened Nov 8, 2024
web demo替换自训练det模型出问题，求大佬解答（看过issue里的关于web demo的问题，没有解决） Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2546 · 2 comments · Opened Nov 4, 2024
TrtBackend::LoadTrtCache加载tensorrt模型时报错 Open

PaddlePaddle/FastDeploy#2544 · 1 assignee · Opened Oct 31, 2024
华为Ascend310P卡死了 Open

PaddlePaddle/FastDeploy#2543 · 1 assignee · Opened Oct 30, 2024
cannot open shared object file: No such file or directory Open

PaddlePaddle/FastDeploy#2540 · 1 assignee · Opened Oct 28, 2024
在安卓端实现目标跟踪 Open

PaddlePaddle/FastDeploy#2539 · 1 assignee · Opened Oct 24, 2024
自训练了ocr的det模型，用的v3，但是在Android中运行报错，直接用demo能够正常运行，求解答 Open

PaddlePaddle/FastDeploy#2538 · 3 comments · 1 assignee · Opened Oct 22, 2024
请问一下fastdeploy_serving支持ascend（310/910）系列部署吗？ Open

PaddlePaddle/FastDeploy#2532 · 1 assignee · Opened Oct 10, 2024
相同的模型结构，不同的参数，预测时间差异很大 Open

PaddlePaddle/FastDeploy#2531 · 2 comments · 1 assignee · Opened Oct 10, 2024
希望能够支持华为910b3，cann8.0 Open

Feature Request

PaddlePaddle/FastDeploy#2521 · 1 assignee · Opened Sep 7, 2024
OCR Cpu与Gpu推理结果不一致，Cpu错误 Open

PaddlePaddle/FastDeploy#2519 · 4 comments · 1 assignee · Opened Sep 3, 2024
模型直接推理没错，服务化部署后，客户端请求后结果不对 Open

PaddlePaddle/FastDeploy#2514 · 1 assignee · Opened Aug 27, 2024
重复刷新模型造成的内存泄露问题 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2511 · 6 comments · Opened Aug 26, 2024
测试rvm Pfld Pipnet 感觉都有点问题 Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2510 · 2 comments · Opened Aug 26, 2024
使用Fastdeploy之后就无法导入Taskflow？另外同一进程无法加载两个Fastdeploy模型？ Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

PaddlePaddle/FastDeploy#2506 · 2 comments · Opened Aug 15, 2024
fastdeploy使用openvino推理后端在ppocr-v3模型上的推理速度问题 Open

PaddlePaddle/FastDeploy#2504 · 1 assignee · Opened Aug 8, 2024
jetson上pptinypose输出异常 Open

PaddlePaddle/FastDeploy#2502 · 1 assignee · Opened Aug 5, 2024

PaddlePaddle/FastDeploy

Get new issues in your inbox