aws / aws/amazon-codeguru-profiler-python-agent

Missing data for processes started with ProcessPoolExecutor

未关闭
#49 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
16
派生
12
PR 合并指标
30 天内没有已合并 PR

描述

We have a Flask application with Gunicorn running on AWS Fargate. Our application has part of the business logic executed in parallel, using ProcessPoolExecutor. The executor, including the worker processes are reused and long running.
We have noticed that we are missing profiling data for the logic executed in worker processes. We have attempted to start new profiler for worker processes using ProcessPoolExecutor initializer, but this attempt has failed with message that we can't start the profiler twice within the same process.

贡献指南

打开贡献指南

调研方向

首先,在 AWS Fargate 上复现使用长期运行的 ProcessPoolExecutor 及其 initializer 的 Flask 和 Gunicorn 设置。调查 worker 进程中的 profiler 生命周期;当能够收集 executor worker 的 profiling 数据且不会触发 duplicate-profiler-start error 时,即视为完成。

由索引模型根据 Issue 内容生成。

评估

技术栈
aws, flask, python
领域
backend, observability-sre
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
需要澄清
新手友好度
25/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。