Investigate: structured feedback classification as a cross-cutting protocol
@abeltrano ci sta già lavorando.
Dal 2/4/2026.
Valutazione
Questa issue non è ancora stata valutata.
Descrizione
Motivation
PR #166 added a feedback classification rule to the spec-extraction-workflow template (Phase 3) that requires the LLM to categorize user feedback as Editorial, Correction, or Finding — defaulting to Finding when uncertain. This prevented a real failure mode where domain-expert feedback was silently under-promoted to a cosmetic change.
The underlying problem — LLMs default to the lowest-impact interpretation of user input — is not specific to spec extraction. Any interactive template where the user provides feedback mid-workflow is susceptible.
Investigation Questions
-
Which templates have interactive feedback loops? Candidates include:
interactive-design(Phase 1 reasoning loop)extend-library(contributor guidance workflow)engineering-workflow/collaborate-requirements-change(iterative change propagation)evolve-protocol(protocol modification loop)author-north-star(section-by-section drafting with user review)author-presentation(multi-phase with user review)maintenance-workflow(finding classification with user collaboration)- Any template using the
iterative-refinementprotocol
-
Should this be a protocol rather than per-template guidance? If the pattern applies broadly, it may belong as:
- A new guardrail protocol (e.g.,
feedback-classification) applied to all interactive templates - An addition to the existing
iterative-refinementprotocol (since that protocol already governs how changes are applied during feedback loops) - A section in the
anti-hallucinationprotocol (since under-promoting feedback is a form of information loss)
- A new guardrail protocol (e.g.,
-
Does the classification taxonomy need to be richer for other contexts? The current three categories (Editorial / Correction / Finding) were designed for spec extraction. Other templates might need:
- Scope change — user wants to expand or narrow the task
- Constraint — user is adding a new constraint not previously stated
- Preference — user is expressing a stylistic or approach preference (not a requirement)
- Rejection — user is rejecting a proposed element entirely
-
What is the interaction with existing protocols?
iterative-refinementalready says 'justify every change' — should feedback classification be embedded there?requirements-elicitationalready decomposes user input — should it also classify the input type?adversarial-falsificationalready has confidence classification — is there overlap?
-
What form should it take?
- A standalone guardrail protocol (
protocols/guardrails/feedback-classification.md) - An extension to
iterative-refinementprotocol - Guidance in
bootstrap.mdfor all interactive templates - A combination (protocol + bootstrap guidance)
- A standalone guardrail protocol (
Suggested Approach
- Audit all interactive templates and the
iterative-refinementprotocol for feedback handling gaps - Draft a candidate protocol or protocol extension
- Test it against 2-3 real interactive sessions to validate the taxonomy
- Propose via
extend-librarytemplate contribution workflow
Related
- #165 — Original issue (spec-extraction-workflow specific fix)
- #166 — PR implementing the spec-extraction-specific classification rule
- Lingua principale
- JavaScript
- Stelle
- 105
- Fork
- 23
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Guida per i contributori
Apri la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di microsoft/PromptKit
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
-
enhancement
Difficoltà 5/5 Più di una settimana Idoneità per principianti 35/100
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 38/100
-
Difficoltà 5/5 Più di una settimana Idoneità per principianti 30/100
Tutte le issue di microsoft/PromptKit
Issue simili
-
code-quality refactoring
Difficoltà 2/5 1-3 ore Idoneità per principianti 84/100
github/gh-aw-firewall#8816 ·
-
integration:quickjs org:external priority:backlog topic:code-interpreter topic:middleware type:feature
Difficoltà 2/5 1-3 ore Idoneità per principianti 74/100
langchain-ai/deepagents#6450 ·
-
optimization optimization:agents-md-curator
Difficoltà 2/5 1-3 ore Idoneità per principianti 86/100
githubnext/gh-aw-cao#13143 ·
-
status: needs triage
Difficoltà 2/5 1-3 ore Idoneità per principianti 88/100
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 88/100