PaddlePaddle / PaddlePaddle/FastDeploy

dynamic_batching 怎么设置呢

Open
#2,603 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
3.7k
Forks
756
Avg merge
19h 28m
Merged PRs (30d)
4

Description


温馨提示:根据社区不完全统计,按照模板提问,可以加快回复和解决问题的速度


环境

  • 【FastDeploy版本】: registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-gpu-cuda11.4-trt8.5-21.10
  • 【编译命令】
  • 【系统平台】: centos
  • 【硬件】: 说明具体硬件型号,如 Nvidia GPU 3080TI, CUDA 11.2 CUDNN 8.3
  • 【编译语言】: C++ / Python(3.7或3.8等)

问题日志及出现问题的操作流程

  • 服务化,设置的config.pbtxt 设置了max_batch_size 和dynamic_batching,返回只有一个box

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the service configuration shown in config.pbtxt, focusing on max_batch_size and dynamic_batching, and reproduce the reported response that contains only one box using the FastDeploy 1.0.7 GPU image. Check the service logs and the request flow; done means identifying whether batching is configured correctly or documenting the missing environment details needed to diagnose it.

Written by the indexing model from the issue text.

Assessment

Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.