Long-running agent sessions exhaust event storage and appear cancelled while CLI remains active
Nadie ha tomado este issue todavía.
- Lenguaje dominante
- Shell
- Estrellas
- 11.2k
- Forks
- 1.9k
- Merge medio
- 14 h 16 min
- PR fusionados (30 d)
- 6
Descripción
Description
Long-running Copilot CLI project sessions that spawn many subagents can exhaust the remote session event store. Once this happens, session status and handoffs become unreliable: sessions appear inactive or cancelled even though their CLI processes remain alive and may still be executing subagents.
Environment
- Copilot CLI:
1.0.79-5 - OS: Windows
- Workload: multiple long-running project/worktree sessions using custom agents with planner, debugger, impact-analysis, coverage, and review subagents
Reproduction
-
Start a project session that performs a multi-hour workflow with frequent tool calls, planner checkpoints, and nested subagents.
-
Allow the session to accumulate a large event history.
-
Observe repeated exporter failures such as:
Failed to submit events to Mission Control session …: 409 {"code":"session_event_storage_exhausted","message":"session event storage exhausted"} remote session batch flush failed … "event_count":500 remote session exporter circuit opened after batch flush failure -
Query the session through the app/runtime status APIs.
Actual behavior
- The project session may lose its
active_session_idor appear inactive. - Background-agent status may report
Cancelledor no agents, without a cancellation reason. - Final handoffs may not arrive.
- Restarting based on this status can create a second writer for the same dirty worktree.
- The underlying CLI process can still be alive, consuming CPU, updating its log, and executing internal subagents after the UI/runtime reports no active work.
- Logs can also report cleanup of many orphaned tool calls, but do not identify a timeout, quota, or other cancellation cause.
Expected behavior
- Event storage should rotate, compact, or start a continuation stream before exhaustion.
- Exporter failure should not make an otherwise-running session unsteerable or misreport its liveness.
- Status should distinguish at least: CLI alive, agent running, agent idle, export disconnected, and task cancelled.
- Cancellation should always expose a reason such as user request, timeout, execution budget, parent teardown, or storage failure.
- The runtime should prevent or clearly warn about concurrent writers when recovery is attempted for a worktree whose original process is still active.
Impact
This makes long-running autonomous work unsafe to recover. Users cannot tell whether work has stopped, and a reasonable restart attempt can cause concurrent edits in the same worktree. Dirty changes were preserved in this case, but reliable coordination required inspecting local process IDs and logs rather than the product status APIs.
Suggested mitigation
Automatically rotate or compact session event history near the storage limit, preserve a local liveness/control channel when remote export fails, and surface a prominent event storage exhausted health state with recovery guidance.
Guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Línea de trabajo
Comienza reproduciendo la sesión de proyecto de varias horas e inspecciona los fallos del exporter, las APIs de estado de runtime y los registros locales de procesos y sesiones descritos en el informe. Compara el estado notificado con el CLI y los subagentes que siguen ejecutándose. Se considera terminado cuando el agotamiento del almacenamiento se gestiona o se muestra claramente, los estados de liveness y los motivos de cancelación se pueden distinguir, y la recuperación no puede crear escritores concurrentes.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- shell
- Área
- backend-api-design, cli, observability
- Tipo de issue
- Error
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Estado de actividad
- Tranquilo
- Claridad
- Bastante claro
- Aptitud para principiantes
- 35/100