PostHog / PostHog/wizard

Health check blocks pi/OpenAI-only runs on Anthropic outages

Open
#918 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

wizard-pain
Dominant language
TypeScript
Stars
197
Forks
51
Avg merge
1d 23h
Merged PRs (30d)
94

Description

Hit live during a benchmark run on 2026-07-17: Anthropic's status page reported a disruption, and the wizard refused to start pi-harness orchestrator runs (wizard-use-pi-harness=true, gpt-5.6 models) that never call Anthropic:

label=base-memos elapsed=2s outro=NO   <- health-check abort
label=r3-memos   elapsed=3s outro=NO   <- pi/OpenAI-only, blocked anyway

DEFAULT_WIZARD_READINESS_CONFIG in src/lib/health-checks/readiness.ts blocks every run when Anthropic is down — and even when merely degraded — regardless of which harness the run resolves to:

downBlocksRun: ['anthropic', 'npmOverall', 'llmGateway', 'mcp', 'githubReleases'],
degradedBlocksRun: ['anthropic'],

The precedent already exists in the same file: SIGNUP_WIZARD_READINESS_CONFIG narrows the blocking set for provisioning flows because "it doesn't use Anthropic directly". The run readiness config could do the same — gate on the providers the resolved harness actually uses.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in src/lib/health-checks/readiness.ts and compare DEFAULT_WIZARD_READINESS_CONFIG with SIGNUP_WIZARD_READINESS_CONFIG. Trace how the resolved harness identifies the providers a run uses, then adjust readiness gating so an Anthropic outage does not block pi/OpenAI-only runs. Done means those runs can start during Anthropic downtime while providers they actually use remain blocking.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
tooling
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
68/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.