`TO_BOOL_INT` repeatedly misses for non-compact exact integers
還沒有人認領這個 Issue。
- 主要語言
- Python
- 星號
- 77.2k
- 分支
- 35.9k
- PR 合併指標
- PR 指標待擷取
描述
Feature or enhancement
Proposal:
Versions
CPython 3.15.0b4, Ubuntu 24.04.4 LTS, gcc 13.3.0
Enhancement
I noticed that the specialization function for TO_BOOL and the guard used by TO_BOOL_INT accept different sets of integers.
_Py_Specialize_ToBool() selects TO_BOOL_INT for any exact integer:
if (PyLong_CheckExact(value)) {
specialized_op = TO_BOOL_INT;
goto success;
}
However, the TO_BOOL_INT macro uses _GUARD_TOS_INT, and that requires the integer to be compact:
op(_GUARD_TOS_INT, (value -- value)) {
PyObject *value_o = PyStackRef_AsPyObjectBorrow(value);
EXIT_IF(!_PyLong_CheckExactAndCompact(value_o));
}
As a result, a non-compact exact integer can cause TO_BOOL_INT to be selected and then immediately miss its guard.
This mismatch appears to have been introduced by GH-143759. Before the refactoring, TO_BOOL_INT had its own PyLong_CheckExact() guard. The refactoring replaced it with a macro using the shared _GUARD_TOS_INT, whose domain is narrower.
I see two alternative ways to fix this.
Option 1: narrow the specialization function
One option would be to change the integer check in _Py_Specialize_ToBool() so that it agrees with the existing guard:
if (_PyLong_CheckExactAndCompact(value)) {
specialized_op = TO_BOOL_INT;
goto success;
}
With this change, non-compact integers remain on the generic TO_BOOL path instead of repeatedly entering and missing TO_BOOL_INT.
My main concern with this option was whether the additional compactness check in the specialization function could regress the common case (compact int), so I benchmarked both compact and non-compact integers.
The benchmark target contained 100 TO_BOOL sites and was warmed up before each measurement:
start = time.perf_counter_ns()
for _ in range(10_000):
target(value)
elapsed = time.perf_counter_ns() - start
Positive values mean that the patched build was faster:
| Version | Input | Performance change |
|---|---|---|
| CPython 3.15 | non-compact exact int | +2.21% (95% CI: +1.64% to +2.86%) |
| CPython 3.15 | compact exact int | +0.31% (95% CI: −0.15% to +0.70%) |
| CPython main | non-compact exact int | +4.03% (95% CI: +1.43% to +7.10%) |
| CPython main | compact exact int | −0.23% (95% CI: −0.50% to +0.07%) |
The non-compact case improved because it no longer repeatedly enters and misses TO_BOOL_INT. For compact integers, both confidence intervals include zero, so I did not find evidence that the stronger specialization check causes a regression.
Option 2: give TO_BOOL_INT an exact-int guard
The other option is to keep _Py_Specialize_ToBool() unchanged and add a guard that checks exact type without requiring compactness:
op(_GUARD_TOS_EXACT_INT, (value -- value)) {
PyObject *value_o = PyStackRef_AsPyObjectBorrow(value);
EXIT_IF(!PyLong_CheckExact(value_o));
}
The TO_BOOL_INT macro would then use the new guard:
macro(TO_BOOL_INT) =
_GUARD_TOS_EXACT_INT +
unused/1 +
unused/2 +
_TO_BOOL_INT +
_POP_TOP_INT;
This would restore the specialization domain from before GH-143759.
I am not sure which of these two options is preferable, but the current mismatch seems worth fixing, so I am opening this issue to get feedback on which direction would be better.
Has this already been discussed elsewhere?
No response given
Links to previous discussion of this feature:
No response
Linked PRs
- gh-155531
- gh-155699
- gh-155700
貢獻指南
從這裡開始
- 先讀完整個 Issue,再讀專案的貢獻指南。
- 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
- Fork 儲存庫,在一個分支上完成修改。
- 送出 Pull Request,並在描述裡引用這個 Issue 編號。
研究方向
從 Python/specialize.c 中的 _Py_Specialize_ToBool() 以及 Python/bytecodes.c 中的 TO_BOOL_INT 和 _GUARD_TOS_INT 開始。查看相關的 PR gh-155531、gh-155699 和 gh-155700,然後重現所述的預熱基準測試;當 specialization 網域和 guard 網域達成一致且不再反覆 miss 時,即表示完成。
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- c, python
- 領域
- compilers, performance
- Issue 類型
- 功能
- 難度
- 4/5
- 預估耗時
- 3-5 天
- 活躍度
- 停滯
- 描述清晰度
- 基本清楚
- 新手友好度
- 35/100