python / python/cpython

Python `io.open` intermittently throw `PermissionError` on windows

Abierto
#136,965 13 comentarios 0 reacciones 0 asignados Ver en GitHub

Nadie ha tomado este issue todavía.

OS-windows pending topic-IO type-bug
Lenguaje dominante
Python
Estrellas
77.2k
Forks
35.9k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

Bug report

Bug description:

The io.open method intermittently raises a PermissionError on the Windows operating system. I've attached a Python script that reproduces this issue on version 3.12.8, and 3.11.9 (didn't test for any other version)

My investigation suggests that the problem arises from consecutive write operations performed within very short timeframes where each operation does fresh io.open to write updates -- For example, when attempting to write 10 updates back-to-back to a file with fresh io.open each time.

On Windows, explorer.exe runs in the background to update indexing and metadata upon file modification. If explorer.exe has already acquired a handle to the file, any new request to write to it will result in a PermissionError.

While we could implement a retry mechanism with backoff for io.open in our code, I'm curious why Python doesn't natively handle such background process contention.

import time
import threading
import random
import multiprocessing
import os

# Sample message text
MESSAGE = (
    r"file://C:\Users\sample\Desktop\temp\tmpgzy8f_lt\929cec70297d4938b31545f858d6b38c.txt,"
    r"gs://sample-bucket/loadwintest/hdahsdhahdahsdhahd/temp/dahsdhahdhadhahdh/dhahsdahdhahdhahdahdhahdha.txt,"
    r"2025-07-21T10:44:43.263442Z,2025-07-21T11:00:55.588213Z,dahshdahdhahdhahshah+hfQ==,25000000000,25000000000,OK,"
)

# Output file path
output_file = "winman/test_output11.txt"


# Writer process – gets messages from queue and writes to file
def writer(queue, end_time):
    while time.time() < end_time:
        msg = queue.get()
        with open(output_file, "at", encoding='utf-8', newline='\n') as f:
            f.write(msg + '\n')


# Thread that puts messages into the queue
def thread_worker(queue, thread_id, process_id, end_time):
    while time.time() < end_time:
        notify_msg = f"[P{process_id}-T{thread_id}] {MESSAGE}"
        queue.put(notify_msg)
        time.sleep(random.choice([0.3, 0.5, 0.4]))


# Process that spawns multiple threads
def process_worker(queue, num_threads, process_id, end_time):
    threads = []
    for tid in range(num_threads):
        t = threading.Thread(target=thread_worker, args=(queue, tid, process_id, end_time))
        threads.append(t)
        t.start()

    for t in threads:
        t.join()


def main():
    runtime_seconds = 600
    end_time = time.time() + runtime_seconds

    num_processes = 4
    threads_per_process = 4

    queue = multiprocessing.Queue()

    # Start writer process
    writer_proc = multiprocessing.Process(target=writer, args=(queue, end_time))
    writer_proc.start()

    # Start worker processes
    processes = []
    for pid in range(num_processes):
        p = multiprocessing.Process(target=process_worker, args=(queue, threads_per_process, pid, end_time))
        p.start()
        processes.append(p)

    # Wait for all worker processes
    for p in processes:
        p.join()

    # Terminate writer after work is done
    writer_proc.terminate()
    writer_proc.join()


if __name__ == "__main__":
    main()
CPython versions tested on:

3.12

Operating systems tested on:

Windows

Guía de contribución

Abrir la guía de contribución

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Línea de trabajo

Comienza ejecutando el reproductor de errores de Python adjunto en Windows con las versiones de CPython indicadas y confirma si se puede reproducir el PermissionError intermitente. Después, inspecciona el punto de entrada io.open y el comportamiento relevante de apertura de archivos en Windows; el trabajo debe establecer una causa reproducible y una solución claramente delimitada o una limitación documentada.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
python
Área
operating-systems
Tipo de issue
Error
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Estancado
Claridad
Necesita aclaración
Aptitud para principiantes
20/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.