microsoft / microsoft/vscode-dotnettools

[P1][Tier 3] Review-comment to harness loop (recurring comments become durable assets)

Open
#3,389 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

AIEngineering
Dominant language
No language data
Stars
321
Forks
54
Avg merge
2d 19h
Merged PRs (30d)
2

Description

Tier 3 — Workflow adoption · Priority: P1

Gap

We have a generic "correct-once loop" in Tier 5 (#3291), but no explicit review-comment → harness workflow step: recurring PR review comments should be converted into durable harness assets (instructions, tests, analyzer rules, or skills) rather than only being fixed in the current PR. dotnet/sdk's epic (#55185) places this in Tier 3 as a distinct workflow step. This is also the manual practice already happening around the Change-Reviewer agent, and it dovetails with the automated-review pipeline (#3282, PR !764574, Automated-PR-Reviewer wrapper).

Investment
  • Define a lightweight loop: when a review comment recurs (human or automated review), capture it as an instruction, test, analyzer rule, or skill update — closing the gap in the harness, not just the PR.
  • Wire this into the automated-review pipeline so recurring Change-Reviewer findings feed back into skills/instructions.
Acceptance criteria
  • A documented review-comment → harness loop (who captures, where it lands: instructions / tests / analyzers / skills).
  • At least one recurring review finding converted into a durable harness asset as a worked example.
  • Cross-linked with the correct-once loop (#3291) and the automated-review work (#3282).
Reference
  • Adopted from dotnet/sdk epic #55185 (Tier 3 → "review-comment-to-harness loop").

Part of epic #3273

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the linked correct-once loop (#3291), automated-review work (#3282), and the Change-Reviewer workflow described in this issue. Define where recurring findings become instructions, tests, analyzers, or skills, then document the capture loop and add one worked example. Done means the loop is documented, one finding is converted into a durable harness asset, and the related issues are cross-linked.

Written by the indexing model from the issue text.

Assessment

Domain
developer-experience, documentation, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.