github / github/copilot-cli

Rubber duck reviews leave no verifiable record: independence and findings are unauditable after the session

オープン
#4,621 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る

まだ誰も着手していません。

area:agents area:sessions
主要言語
Shell
スター
11.2k
フォーク
1.9k
平均マージ
14時間 16分
マージ済み PR(30日)
6

説明

Describe the feature or problem you'd like to solve

Rubber duck reviews leave no verifiable record. The critique, the model that produced it, and what the session did with each finding all die with the session. #4380 and #4432 show why this matters: the independence guarantee (complementary family) can fail silently, and today the only way users can even detect that is by hand-extracting evidence from process logs and events.jsonl. The review's most valuable properties, who reviewed whom and what remained unresolved, are currently unauditable after the fact.

Proposed solution

Persist a small structured record per rubber duck invocation, next to the session or exportable to the repo: orchestrator model and family, reviewer model and family, how the reviewer was selected (complementary, inherited, explicitly overridden, and by whom), a hash of the review prompt, and the findings with their disposition (addressed, dismissed, left open).

Benefits: silent independence failures like #4380 and #4432 become visible in the record instead of requiring log forensics; teams can sample reviews after merge; and what the review left OPEN (unverified assumptions, accepted tradeoffs) survives as provenance instead of dying in the terminal.

Example prompts or workflows
  1. After a rubber duck pass, /rubber-duck export writes the review record to a file the user can commit alongside the change.
  2. A team samples merged PRs weekly and checks the records: which reviews ran cross-family, which findings were dismissed without evidence.
  3. CI warns when a PR's rubber duck record shows reviewer and orchestrator from the same family (the #4380 case, caught at review time instead of never).
  4. An auditor asks "what did the review leave open?" and gets an artifact, not a chat scrollback.
Additional context

Open disclosure: I maintain disensor (https://github.com/NicolasRocchia/disensor, MIT), a provider-neutral CLI and Action that formalizes exactly this record for adversarial review rounds (schema residue/v0.4: reviewer family and declared independence, prompt hash, findings with terminal states, residue declaration, CI gate). The method behind it is documented with data from 91 review events (DOI 10.5281/zenodo.21633495). Happy for any part of the schema to serve as reference or prior art; the point of this request is that the review record should exist, whoever implements it.

コントリビューションガイド

コントリビューションガイドを開く

はじめの一歩

  1. issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
  2. 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
  3. リポジトリをフォークし、ブランチを切って変更します。
  4. issue 番号を参照したプルリクエストを送ります。

調査の方向性

まず、issue で言及されている rubber-duck の呼び出しを追跡し、プロセスログと events.jsonl の証拠を確認します。各呼び出しがモデル、選択理由、プロンプトハッシュ、調査結果、処置をどのように記録するかを定義し、続いて /rubber-duck export がアーティファクトをどのように出力すべきかを調べます。セッション後も記録が保持され、独立性と未解決の調査結果を確認できれば完了です。

索引モデルが issue の本文から書いたものです。

評価

技術スタック
shell
領域
cli, observability
issue の種類
機能追加
難易度
5/5
見積もり時間
1週間以上
活発さ
活発
明瞭さ
おおむね明確
初心者へのやさしさ
35/100

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。