microsoft / microsoft/PromptKit
Pipeline quality gates: mandatory audit steps between pipeline stages
Nobody has claimed this yet.
- Dominant language
- JavaScript
- Stars
- 105
- Forks
- 23
- PR merge metrics
- No merged PRs in 30d
Description
Summary
Add quality gates as a first-class pipeline concept — mandatory or recommended audit/verification steps that run between pipeline stages before the next stage can proceed.
Motivation
GitHub Spec Kit builds quality gates directly into its workflow:
- Spec quality checklist — After specification creation, validates completeness, testability, and ambiguity
- Constitution compliance — Before planning, checks that the spec doesn't violate project principles
- Pre-implementation checklist — Before coding, verifies all checklist items pass (stops and asks if failures exist)
- Consistency analysis — After task breakdown, validates spec ↔ plan ↔ tasks alignment with severity levels (CRITICAL > HIGH > MEDIUM > LOW)
These gates are mandatory, not opt-in, which is what makes them effective.
PromptKit already has the building blocks:
audit-traceability— validates cross-document alignmentaudit-spec-alignment— checks spec ↔ implementation alignmentaudit-code-compliance— checks code ↔ spec alignmentaudit-test-compliance— checks test ↔ spec alignment
The gap: pipelines don't declare which audits should run between stages.
Proposed Design
-
Pipeline schema extension: Add an optional
gatefield to pipeline stage transitions inmanifest.yaml:pipelines: document-lifecycle: stages: - template: author-requirements-doc output_contract: requirements-document - gate: audit-traceability # ← NEW: must pass before next stage severity: warning # or "blocking" - template: author-design-doc input_contract: requirements-document output_contract: design-document - gate: audit-spec-alignment severity: blocking -
Bootstrap engine integration: When running a pipeline interactively, the bootstrap engine would execute gate templates between stages and report pass/fail before proceeding
-
CLI integration:
npx promptkit assemblecould emit a note about recommended gates when assembling a pipeline stage
Credit
This pattern is inspired by GitHub Spec Kit's built-in quality checkpoints. See their plan-template.md (constitution compliance gate) and checklist-template.md (pre-implementation quality validation) for the original implementation.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the pipeline definitions in manifest.yaml, then trace how the bootstrap engine runs stages and how the npx promptkit assemble CLI handles pipeline stages. Map where gate entries, severity, pass/fail behavior, and the recommended-gate note would be represented. Done means the schema, interactive execution, and CLI behavior consistently support the proposed mandatory or recommended gates.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- cli, tooling
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100