Azure / Azure/azure-functions-python-worker

Addressing Limitations in Python Function Execution Model with Asyncio Event Loop in Azure Functions

Abierto
#1,574 0 comentarios 0 reacciones 0 asignados Ver en GitHub
area:python-functions feature python
Lenguaje dominante
Python
Estrellas
357
Forks
116
Merge medio
32 min
PR fusionados (30 d)
1

Descripción

Description:

We have identified foundational limitations in the Python function execution model within the Azure Functions Python Worker that have impacted multiple durable Python customers. The current model runs all asynchronous function calls within a single asyncio event loop, leading to several constraints and challenges that need to be addressed:

Execution Order of Invocations:

The order in which invocations are received and executed is subject to the scheduling logic of the asyncio event loop, resulting in potentially random execution order. Currently, we cannot guarantee a first-come, first-served execution model.
Invocation Timeout Tracking:

There is no mechanism for tracking the real status of an invocation when it times out. The timeout could result from a genuinely long-running invocation, or it might be due to the worker not picking up the invocation for an extended period (e.g., 15 minutes) because the event loop is busy with other tasks. Additionally, the loop may become stuck processing one or more "bad" async calls (i.e., calls declared as async but performing blocking operations). The Function Host sends the request to the worker and begins measuring the timeout, but there is no explicit acknowledgment, status check, or fast-fail mechanism for these bad async calls currently in place.
Monitoring Event Loop Status:

Currently, there is no platform support for real-time monitoring of the asyncio event loop's running status or the ability to take snapshots to diagnose potential issues.
Reference to the relevant code: https://github.com/Azure/azure-functions-python-worker/blob/b734c57b3b81b3cad2f84951ee79c3a493504e32/azure_functions_worker/dispatcher.py#L659C13-L669C62

These challenges present significant difficulties for customers relying on durable/ non durable Python functions, and we are looking for potential enhancements to address these limitations.

++ @davidmrdavid @andystaples @vrdmr @gavin-aguiar @hallvictoria @fabiocav

### Expected Behavior

_No response_

### Relevant sample code snipped

_No response_

### Additional Information

_No response_

Guía de contribución

Abrir la guía de contribución

Línea de trabajo

Empieza en azure_functions_worker/dispatcher.py, alrededor de las líneas 659-669, y sigue cómo se programan y gestionan las invocaciones asíncronas. Aclara el comportamiento esperado para el orden de las invocaciones, el seguimiento del estado de timeout, el fallo rápido de las llamadas asíncronas bloqueantes y la monitorización del bucle de eventos antes de cambiar el código. Se considera terminado cuando las mejoras acordadas estén implementadas con un comportamiento verificable, pero actualmente el issue no proporciona criterios de aceptación ni pruebas específicos.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
azure, python
Área
backend, cloud
Tipo de issue
Nueva funcionalidad
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Estancado
Claridad
Necesita aclaración
Aptitud para principiantes
25/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.