ContextLab / ContextLab/orchestrator

Scale the agentic runtime to distributed workers and messaging

Open
#487 0 comments 0 reactions 0 assignees View on GitHub
architecture enhancement
Dominant language
Python
Stars
3
Forks
2
Avg merge
13m
Merged PRs (30d)
1

Description

## Origin

Deferred from the MVP proposed as a fresh realization of #485.

## Goal

Scale the single-machine durable runtime into a multi-process and eventually distributed worker system without changing its event-sourced execution semantics.

## Scope

- Replace local worker leases/notifications with database- and queue-backed primitives.
- Define worker identity, heartbeats, lease expiry, orphan recovery, backpressure, and fair scheduling.
- Support direct typed addressing in addition to parent/child routing, with authorization and hop/fan-out limits.
- Add cancellation and interruption at deterministic checkpoints.
- Detect deadlock/livelock and expose operator diagnostics.
- Load-test hundreds of concurrent logical nodes and multiple simultaneous runs.

## Prerequisite

The MVP must first establish replay, idempotency, message-boundary, and state-transition semantics on one machine. Distribution must preserve those contracts rather than define new ones accidentally.

## Acceptance criteria

- [ ] Multi-worker execution produces the same projections as the single-process reference runner.
- [ ] Worker death, duplicate delivery, delayed messages, and lease theft are covered by fault-injection tests.
- [ ] Backpressure and budget limits remain enforceable under concurrency.
- [ ] A run can be cancelled and resumed without duplicate completed effects.
- [ ] Throughput/latency curves and operational limits are documented.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.