simvue-io / simvue-io/python-api
Psutil not detecting correct child processes
Open
Nobody has claimed this yet.
backlog
- Dominant language
- Python
- Stars
- 4
- Forks
- 1
- Avg merge
- 5d 8h
- Merged PRs (30d)
- 4
Description
CPU resource utilization metrics for MPI jobs on SLURM systems appear to be inaccurate, suspect since psutil is not identifying the correct child processes of the main job:
executor _processes dict_values([<Popen: returncode: None args: ['mpiexec', '-n', '20', 'fds', 'office_atria_...>])
child psutil.Process(pid=2546114, name='srun', status='sleeping', started='14:29:20')
child psutil.Process(pid=2546115, name='srun', status='sleeping', started='14:29:20')
child psutil.Process(pid=2546115, name='srun', status='sleeping', started='14:29:20')
Would expect to see a series of FDS child processes for each of the 20 cores it is running across, instead just see srun...
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the MPI job on SLURM and inspecting how psutil identifies child processes from the main job. Done means the process list contains the expected FDS children for all 20 cores and CPU resource metrics are accurate.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- observability-sre
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100