anthropics / anthropics/claude-code-action

Automatic PR Code Review solutions are vulnerable to model upgrades

オープン
#1,566 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る
主要言語
TypeScript
スター
8.9k
フォーク
2.1k
平均マージ
3日 9時間
マージ済み PR(30日)
10

説明

Our team uses a Claude auto review workflow based largely on the [enhanced example in the solutions guide](https://github.com/anthropics/claude-code-action/blob/main/docs/solutions.md#enhanced-example-with-progress-tracking). When Opus 5 became the default model late last week, we noticed significant degradation in the quality of reviews.

Previously, it was possible to address Claude's feedback over three or fewer iterations, and see a more or less approving review. With the model upgrade, our team was stuck in a seemingly endless loop of iteration, with Claude finding new issues on every pass.

We've found the workflow incredibly valuable overall, and would like for other teams to be able to derive similar value from the out-of-the-box workflow going forward.

In the short term, we pinned our workflow to Opus 4.8, but I could also imagine updating the example prompt to give a clearer scope to Opus 5 and future models.

コントリビューションガイド

コントリビューションガイドを開く

調査の方向性

Start with docs/solutions.md's enhanced example with progress tracking and compare it with the team's Opus 4.8-pinned workflow. Determine how the example should constrain review scope across Opus 5 and future model upgrades, then verify the documented workflow no longer encourages endless iterations.

索引モデルが issue の本文から書いたものです。

評価

領域
ci-cd, documentation
issue の種類
機能追加
難易度
4/5
見積もり時間
3〜5日
活発さ
静か
明瞭さ
おおむね明確
初心者へのやさしさ
48/100

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。