multiprocessing Pool should allow custom task queue

Open
#50,656 13 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
32/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
backend

Research direction

Start by reading the multiprocessing Pool implementation around _setup_queues and the historical multiproc.patch, which sets up _taskqueue there. Trace how Pool currently creates and uses its task queue before deciding what customization the public API should support. Done means Pool users can provide a custom task queue, with behavior covered by appropriate multiprocessing tests.

Written by the indexing model from the issue text.

Description

stdlib topic-multiprocessing type-feature
BPO 6407
Nosy @pitrou, @akheron, @iritkatriel
Files
  • multiproc.patch: patch: set up _taskqueue in _setup_queues
    		•

    Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
closed_at = None
created_at = <Date 2009-07-03.13:23:17.286>
labels = ['type-feature', 'library']
title = 'multiprocessing Pool should allow custom task queue'
updated_at = <Date 2021-06-29.19:09:17.430>
user = 'https://bugs.python.org/masher'

    bugs.python.org fields:

    activity = <Date 2021-06-29.19:09:17.430>
actor = 'iritkatriel'
assignee = 'jnoller'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2009-07-03.13:23:17.286>
creator = 'masher'
dependencies = []
files = ['14442']
hgrepos = []
issue_num = 6407
keywords = ['patch']
message_count = 12.0
messages = ['90052', '90056', '90067', '90070', '115259', '115260', '119499', '119511', '148170', '148244', '148246', '396753']
nosy_count = 7.0
nosy_names = ['pitrou', 'jnoller', 'asksol', 'masher', 'petri.lehtinen', 'swindmill', 'iritkatriel']
pr_nums = []
priority = 'normal'
resolution = None
stage = 'needs patch'
status = 'open'
superseder = None
type = 'enhancement'
url = 'https://bugs.python.org/issue6407'
versions = ['Python 3.3']

    Dominant language
    Python
    Stars
    77.2k
    Forks
    36k
    Avg merge
    1d 9h
    Merged PRs (30d)
    558

    Contributor guide

    Open the contributing guide

    First steps

    1. Read the whole issue, then the project's contributing guide.
    2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
    3. Fork the repository and make your change on a branch.
    4. Open a pull request that references the issue number.

    More from python/cpython

    All issues in python/cpython

    Similar issues

    More Python issues

    Get new issues in your inbox

    A short digest of beginner-friendly GitHub issues.