multiprocessing.Queue.put can fail silently due to pickle errors

Open
#84,376 11 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
backend

Research direction

Start by running minimal_repr.py to reproduce the silent failure, then trace multiprocessing.Queue.put and its pickle handling. Done means the reported pickle error is no longer silent and relevant multiprocessing behavior is covered by tests.

Written by the indexing model from the issue text.

Description

stdlib topic-multiprocessing type-bug
BPO 40195
Files
  • minimal_repr.py: Minimal example for reproducing the behaviour
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
    closed_at = None
    created_at = <Date 2020-04-05.10:55:01.927>
    labels = ['3.7', 'type-bug', 'library']
    title = 'multiprocessing.Queue.put can fail silently due to pickle errors'
    updated_at = <Date 2020-04-05.10:55:01.927>
    user = 'https://bugs.python.org/SanderLand'
    

    bugs.python.org fields:

    activity = <Date 2020-04-05.10:55:01.927>
    actor = 'Sander Land'
    assignee = 'none'
    closed = False
    closed_date = None
    closer = None
    components = ['Library (Lib)']
    creation = <Date 2020-04-05.10:55:01.927>
    creator = 'Sander Land'
    dependencies = []
    files = ['49036']
    hgrepos = []
    issue_num = 40195
    keywords = []
    message_count = 1.0
    messages = ['365816']
    nosy_count = 1.0
    nosy_names = ['Sander Land']
    pr_nums = []
    priority = 'normal'
    resolution = None
    stage = None
    status = 'open'
    superseder = None
    type = 'behavior'
    url = 'https://bugs.python.org/issue40195'
    versions = ['Python 3.7']
    

    Dominant language
    Python
    Stars
    77.2k
    Forks
    36k
    Avg merge
    1d 9h
    Merged PRs (30d)
    558

    Contributor guide

    Open the contributing guide

    First steps

    1. Read the whole issue, then the project's contributing guide.
    2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
    3. Fork the repository and make your change on a branch.
    4. Open a pull request that references the issue number.

    More from python/cpython

    All issues in python/cpython

    Similar issues

    More Python issues

    Get new issues in your inbox

    A short digest of beginner-friendly GitHub issues.