python / python/cpython

Excessive memory use or memory fragmentation when unpickling many small objects

未关闭
#80,875 8 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

还没有人认领这个 Issue。

3.12 performance stdlib
主要语言
Python
星标
77.2k
派生
36k
PR 合并指标
PR 指标待抓取

描述

BPO 36694
Nosy @pitrou, @avassalotti, @methane, @serhiy-storchaka, @Paul-E
PRs
  • python/cpython#13036
  • Files
  • load.py
  • common.py
  • dump.py
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
    closed_at = None
    created_at = <Date 2019-04-21.17:11:20.009>
    labels = ['3.8', 'library', 'performance']
    title = 'Excessive memory use or memory fragmentation when unpickling many small objects'
    updated_at = <Date 2019-05-02.16:43:18.896>
    user = 'https://github.com/Paul-E'
    

    bugs.python.org fields:

    activity = <Date 2019-05-02.16:43:18.896>
    actor = 'serhiy.storchaka'
    assignee = 'none'
    closed = False
    closed_date = None
    closer = None
    components = ['Library (Lib)']
    creation = <Date 2019-04-21.17:11:20.009>
    creator = 'Ellenbogen'
    dependencies = []
    files = ['48279', '48280', '48282']
    hgrepos = []
    issue_num = 36694
    keywords = ['patch']
    message_count = 8.0
    messages = ['340615', '340616', '340617', '341179', '341181', '341193', '341251', '341284']
    nosy_count = 5.0
    nosy_names = ['pitrou', 'alexandre.vassalotti', 'methane', 'serhiy.storchaka', 'Ellenbogen']
    pr_nums = ['13036']
    priority = 'normal'
    resolution = None
    stage = 'patch review'
    status = 'open'
    superseder = None
    type = 'resource usage'
    url = 'https://bugs.python.org/issue36694'
    versions = ['Python 3.8']
    

    贡献指南

    打开贡献指南

    从这里开始

    1. 先读完整个 Issue,再读项目的贡献指南。
    2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
    3. Fork 仓库,在一个分支上完成修改。
    4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

    调研方向

    首先检查链接的 PR #13036 以及附带的 load.py、common.py 和 dump.py 文件。针对大量小对象重现报告的内存行为,然后将结果与拟议的更改进行比较。当过度的内存使用或碎片化问题得到解决,并且相关的性能行为得到覆盖时,即视为完成。

    由索引模型根据 Issue 内容生成。

    评估

    技术栈
    python
    领域
    performance
    Issue 类型
    缺陷
    难度
    4/5
    预计耗时
    3-5 天
    活跃度
    停滞
    描述清晰度
    基本清楚
    新手友好度
    25/100

    把新 issue 发到你的邮箱

    精选适合新手参与的 GitHub issue 摘要。