`multiprocessing.Pool` fails if command has a long list of arguments (regression in 3.14.3, 3.13.12)
@gpshead 已经在做这个了。
开始于 2026年4月7日。
- 主要语言
- Python
- 星标
- 77.2k
- 派生
- 35.9k
- PR 合并指标
- PR 指标待抓取
描述
Bug report
Bug description:
A multiprocessing pool can fail to start when the command that starts the pool was ran with a lot of arguments.
Minimal working example:
# mwe.py
import multiprocessing
if __name__ == "__main__":
with multiprocessing.Pool():
pass
Run this using the following script:
#!/bin/bash
PAGE_SIZE=$(getconf PAGE_SIZE)
MAX_ARG_STRLEN=$((32 * PAGE_SIZE))
COUNT=$((MAX_ARG_STRLEN / 100 ))
echo $COUNT
yes "$(printf 'a%.0s' {1..100})" | head -n $COUNT | xargs python3 mwe.py
What this will do is effectively run the following:
python3 mwe.py aaa..a aaa..a aaa..a ... aaa.a
The Python process itself launches correctly, as each argument is only 100 bytes long (way under the maximum argument length of MAX_ARG_STRLEN).
The creation of the multiprocessing pool however fails, because the sys.argv variable is taken, and used to build a single string in multiprocessing.forkserver.ForkServer.ensure_running here: https://github.com/python/cpython/blob/d5cb9f6a9b6f48cc08c4422259498d4fd023357a/Lib/multiprocessing/forkserver.py#L175.
This is caused by a recent change: https://github.com/python/cpython/pull/143717, which was also backported to 3.13 and 3.14. (It works on 3.14.2, fails on 3.14.3).
CPython versions tested on:
3.15, 3.14
Operating systems tested on:
Linux
Linked PRs
- gh-144508
- gh-148194
- gh-148195
- gh-148196
贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
评估
这个 Issue 还没有评估数据。