multiprocessing Queue leaks a file descriptor associated with the pipe writer (#33081 still a problem)
Open
Nobody has claimed this yet.
3.10
3.7 (EOL)
3.8 (EOL)
3.9 (EOL)
stdlib
topic-multiprocessing
type-bug
- Dominant language
- Python
- Stars
- 77.2k
- Forks
- 36k
- PR merge metrics
- PR metrics pending
Description
| BPO | 42752 |
|---|---|
| Nosy | @pitrou, @mattip, @graingert, @applio |
| Files |
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee = None
closed_at = None
created_at = <Date 2020-12-26.23:03:41.032>
labels = ['3.8', '3.9', '3.10', 'performance', '3.7', 'library']
title = 'multiprocessing Queue leaks a file descriptor associated with the pipe writer (#33081 still a problem)'
updated_at = <Date 2022-02-21.11:50:18.407>
user = 'https://bugs.python.org/crazycasta'
bugs.python.org fields:
activity = <Date 2022-02-21.11:50:18.407>
actor = 'vstinner'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2020-12-26.23:03:41.032>
creator = 'crazycasta'
dependencies = []
files = ['49701', '49713']
hgrepos = []
issue_num = 42752
keywords = ['patch']
message_count = 5.0
messages = ['383832', '384149', '384151', '384737', '388632']
nosy_count = 5.0
nosy_names = ['pitrou', 'mattip', 'graingert', 'crazycasta', 'davin']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = 'resource usage'
url = 'https://bugs.python.org/issue42752'
versions = ['Python 3.6', 'Python 3.7', 'Python 3.8', 'Python 3.9', 'Python 3.10']
Linked PRs
- gh-112900
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the uploaded test_queue.py and queue_close_write.patch, then inspect the multiprocessing Queue pipe-writer behavior related to file-descriptor cleanup. Run the supplied queue test and compare the existing behavior with linked PR gh-112900. Done means the reproducer no longer shows the leaked pipe-writer descriptor and the relevant tests pass.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- operating-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100