Rename PyGILState_Check()
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 77.2k
- Forks
- 35.9k
- PR merge metrics
- PR metrics pending
Description
Feature or enhancement
Proposal:
Nearly all of the C-API expects that the current thread holds the GIL when called. Mostly, users of the C-API had to know before calling the C-API. Beck in the day it wasn't obvious how. This was the motivation behind adding PyGILState_Check().
The key point in this issue is that the name PyGILState_Check() unnecessarily associates the capability with the PyGILState_* API. Users would benefit from a different function name. I'd think something like Py_HoldsGIL() would be better.
Why was the function added as PyGILState_Check()? Perhaps @kristjanvalur remembers. It was added in 2013, 10 years after the PEP 311 implementation, so it's not because it was part of the PEP. I'd guess it's mostly because it was implemented using PyGILState_GetThisThreadState().
It's also notable that a lot of things have changed in the runtime since 2013. At the time PyGILState_Check() was added:
- you could use
PyThreadState_Get()(orPyThreadState_GET()) to get the tstate active in the current thread, but only if it held the GIL - you could get the last active tstate in the current thread using
PyGILState_GetThisThreadState() - internally there was a static
PyThreadState_IsCurrent()that sort of merged the two
Here some of the developments since then:
- every tstate now knows whether or not it holds the GIL
- the runtime now keeps track of the last tstate to hold the GIL
- the current tstate has moved from a global variable to a thread-local variable
- each interpreter now has its own GIL
Here's the history in some detail:
(expand)
- 1997 - thread state (& interp state) introduced (commit a027efa5bfa7911b5c4b522b6a0698749a6f2e4a)
- current tstate stored in static global variable
PyThreadState_Get()exposes itPyThreadState_Swap()modifies it- GIL must be held to call it, so that global effectively indicates which tstate (i.e. thread) holds the GIL
- 1998 - added
PyThreadState_GET()macro (commit 275ea67e6b272234c3bccfedf0085308f8969412)- current tstate global variable moved to "internal" C-API (commit 18bc7c227676c91a6cfe97cd571bd0a5a187e373)
- 2003 - PEP 311 adds the
PyGILState_*API (commit 8d98d2cb95a),- last tstate used in current OS thread stored in thread-specific storage (
autoTLSkey) PyGILState_GetThisThreadState()exposes it- it is set to NULL when a tstate is destroyed and it was the last one used in the current thread
- adds static
PyThreadState_IsCurrent()that indicates if that thread-local tstate holds the GIL PyGILState_Check()does not exist yet
- last tstate used in current OS thread stored in thread-specific storage (
- 2009 - new GIL impl (commit 074e5ed974be65fbcfe75a4c0529dbc53f13446f)
- adds new "last_holder" and "held" state
- 2013 -
PyGILState_Check()added (gh-61724, commit 684cd0e64311)- effectively exposes
PyThreadState_IsCurrent(PyGILState_GetThisThreadState())
- effectively exposes
- 2017 -
_PyRuntimeStateadded (commit 2ebc5ce42a8a9e047e790aefbf9a94811569b2b6)- moved "current" tstate from global var in pystate.c (
_PyThreadState_Current) to_PyRuntime.gilstate.tstate_current - moved GILState-related global vars to
_PyRuntime.gilstate - moved GIL from global vars to
_PyRuntime.ceval.gil
- moved "current" tstate from global var in pystate.c (
- 2018 - added
_PyThreadState_GET(), without NULL check (commit 50b48572d9a90c5bb36e2bef6179548ea927a35a) - 2023 - moved "current" tstate from
_PyRuntime.gilstate.tstate_currentto_PyRuntime.tstate_current(commit 6036c3e856f033bf13e929536e7bf127fdd921c9) - 2023 - moved "current" tstate to a thread-local variable in pystate.c (commit f8abfa331421e2c28388c5162f37820495e3c2ee)
- 2023 - added internal
current_thread_holds_gil(commit 92d8bfffbf377e91d8b92666525cb8700bb1d5e8) - 2023 - moved GIL to the interpreter state (commit 5c9ee498c6f4b75e0e020f17b6860309c3b7e11e)
- 2024 - added
PyThreadState._status.holds_gil(commit be1dfccdf2c5c7671b8a549e969b8cf7d60d9936)
Has this already been discussed elsewhere?
No response given
Links to previous discussion of this feature:
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the PyGILState_Check() C-API entry point and the runtime history summarized in the issue, including the proposed Py_HoldsGIL() name. Determine the required public API and compatibility changes; the work is done when the rename is agreed and consistently reflected in the relevant API surface and tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- c, python
- Domain
- api, backend-api-design
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100