aws / aws/amazon-codeguru-profiler-python-agent

Missing data for processes started with ProcessPoolExecutor

Open
#49 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
16
Forks
12
PR merge metrics
No merged PRs in 30d

Description

We have a Flask application with Gunicorn running on AWS Fargate. Our application has part of the business logic executed in parallel, using ProcessPoolExecutor. The executor, including the worker processes are reused and long running.
We have noticed that we are missing profiling data for the logic executed in worker processes. We have attempted to start new profiler for worker processes using ProcessPoolExecutor initializer, but this attempt has failed with message that we can't start the profiler twice within the same process.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.