PostHog / PostHog/wizard

Add framework + monorepo detection CI/eval step

Open
#716 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
197
Forks
51
Avg merge
1d 23h
Merged PRs (30d)
94

Description

Problem

We're starting to rely on agentic detection of project structure (frameworks, monorepo layouts) in the wizard, but we don't yet have an automated way to catch regressions in that detection. The agentic source-map detection landed in #689 and the broader monorepo support is tracked in #113 — both would benefit from a guardrail.

Proposal

Add a CI/eval step that exercises framework and monorepo detection against a set of representative fixture projects, so we can verify detection behavior on every change and catch regressions before they ship.

Rough shape:

  • A corpus of fixture repos / manifests covering common cases (single-app, pnpm/yarn/npm workspaces, mixed framework monorepos, Next.js in a subpackage, etc.)
  • Run the detector against each fixture and assert on the structured JSON output (detected projects, frameworks, chosen manifest globs)
  • Wire it into CI so detection changes are evaluated automatically

References

  • #113 — Add support for monorepos
  • #689 — feat: agentic detection for source-map upload flow

Filed from a Slack thread — reminder from the error tracking team to add a framework + monorepo detection CI/eval step.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the agentic detection work from #689 and the monorepo support in #113, then locate the repository's CI and evaluation entry points. Add representative fixture projects and assertions for structured detection output, and consider the work done when the detector runs against them automatically in CI.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
ci-cd, testing, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.