Investigate: structured feedback classification as a cross-cutting protocol
@abeltrano arbeitet bereits daran.
Seit 02.4.2026.
Bewertung
Dieses Issue wurde noch nicht bewertet.
Beschreibung
Motivation
PR #166 added a feedback classification rule to the spec-extraction-workflow template (Phase 3) that requires the LLM to categorize user feedback as Editorial, Correction, or Finding — defaulting to Finding when uncertain. This prevented a real failure mode where domain-expert feedback was silently under-promoted to a cosmetic change.
The underlying problem — LLMs default to the lowest-impact interpretation of user input — is not specific to spec extraction. Any interactive template where the user provides feedback mid-workflow is susceptible.
Investigation Questions
-
Which templates have interactive feedback loops? Candidates include:
interactive-design(Phase 1 reasoning loop)extend-library(contributor guidance workflow)engineering-workflow/collaborate-requirements-change(iterative change propagation)evolve-protocol(protocol modification loop)author-north-star(section-by-section drafting with user review)author-presentation(multi-phase with user review)maintenance-workflow(finding classification with user collaboration)- Any template using the
iterative-refinementprotocol
-
Should this be a protocol rather than per-template guidance? If the pattern applies broadly, it may belong as:
- A new guardrail protocol (e.g.,
feedback-classification) applied to all interactive templates - An addition to the existing
iterative-refinementprotocol (since that protocol already governs how changes are applied during feedback loops) - A section in the
anti-hallucinationprotocol (since under-promoting feedback is a form of information loss)
- A new guardrail protocol (e.g.,
-
Does the classification taxonomy need to be richer for other contexts? The current three categories (Editorial / Correction / Finding) were designed for spec extraction. Other templates might need:
- Scope change — user wants to expand or narrow the task
- Constraint — user is adding a new constraint not previously stated
- Preference — user is expressing a stylistic or approach preference (not a requirement)
- Rejection — user is rejecting a proposed element entirely
-
What is the interaction with existing protocols?
iterative-refinementalready says 'justify every change' — should feedback classification be embedded there?requirements-elicitationalready decomposes user input — should it also classify the input type?adversarial-falsificationalready has confidence classification — is there overlap?
-
What form should it take?
- A standalone guardrail protocol (
protocols/guardrails/feedback-classification.md) - An extension to
iterative-refinementprotocol - Guidance in
bootstrap.mdfor all interactive templates - A combination (protocol + bootstrap guidance)
- A standalone guardrail protocol (
Suggested Approach
- Audit all interactive templates and the
iterative-refinementprotocol for feedback handling gaps - Draft a candidate protocol or protocol extension
- Test it against 2-3 real interactive sessions to validate the taxonomy
- Propose via
extend-librarytemplate contribution workflow
Related
- #165 — Original issue (spec-extraction-workflow specific fix)
- #166 — PR implementing the spec-extraction-specific classification rule
- Vorherrschende Sprache
- JavaScript
- Sterne
- 105
- Forks
- 23
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beitragsleitfaden
Erste Schritte
- Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
- Forken Sie das Repository und arbeiten Sie in einem Branch.
- Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.
Mehr aus microsoft/PromptKit
-
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 35/100
-
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 35/100
-
enhancement
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 35/100
-
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 38/100
-
Schwierigkeit 5/5 Über eine Woche Anfängerfreundlichkeit 30/100
Alle Issues in microsoft/PromptKit
Ähnliche Issues
-
code-quality refactoring
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 84/100
github/gh-aw-firewall#8816 ·
-
integration:quickjs org:external priority:backlog topic:code-interpreter topic:middleware type:feature
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 74/100
langchain-ai/deepagents#6450 ·
-
optimization optimization:agents-md-curator
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 86/100
githubnext/gh-aw-cao#13143 ·
-
status: needs triage
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 88/100
-
Schwierigkeit 2/5 1-3 Stunden Anfängerfreundlichkeit 88/100