aws / aws/amazon-codeguru-profiler-python-agent
Missing data for processes started with ProcessPoolExecutor
- 主要语言
- Python
- 星标
- 16
- 派生
- 12
- PR 合并指标
- 30 天内没有已合并 PR
描述
We have a Flask application with Gunicorn running on AWS Fargate. Our application has part of the business logic executed in parallel, using ProcessPoolExecutor. The executor, including the worker processes are reused and long running.
We have noticed that we are missing profiling data for the logic executed in worker processes. We have attempted to start new profiler for worker processes using ProcessPoolExecutor initializer, but this attempt has failed with message that we can't start the profiler twice within the same process.
贡献指南
调研方向
首先,在 AWS Fargate 上复现使用长期运行的 ProcessPoolExecutor 及其 initializer 的 Flask 和 Gunicorn 设置。调查 worker 进程中的 profiler 生命周期;当能够收集 executor worker 的 profiling 数据且不会触发 duplicate-profiler-start error 时,即视为完成。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- aws, flask, python
- 领域
- backend, observability-sre
- Issue 类型
- 缺陷
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 需要澄清
- 新手友好度
- 25/100