devondragon / devondragon/ccmagic

review: natural-language review requests do not trigger the skill

Open
#35 3 comments 0 reactions 1 assignee View on GitHub

@devondragon is already working on this.

Since Sep 19, 2026.

Dominant language
Shell
Stars
6
Forks
0
Avg merge
28m
Merged PRs (30d)
5

Description

Observed

In the evals/ review suite pilots (2026-09-18, two runs each), the prompts "Can you review this change before I open the PR?" (case 02-quick-off-by-one) and "Can you code review this? It adds a user search endpoint." (case 04-deep-sql-injection) never invoked /ccmagic:review. The with-plugin arm produced the same plain-prose review as the without-plugin arm: no routing line, no severity grouping, no confidence scores. Only prompts that begin with the explicit /ccmagic:review slash command ran the skill.

Expected

The skill description is "Adaptive code review ...", so a direct request to review a pasted diff should trigger it.

Likely cause

The description frontmatter in skills/review/SKILL.md describes what the skill does but not when to use it. Descriptions that name the user phrasings ("review this diff", "code review", "look over this change before I open a PR") trigger more reliably.

How to verify

Run the suite and check review-fired on cases 02 and 04, plus the routes-quick / routes-deep regex graders:

claude plugin eval . --ablation with-without --judge-model opus --no-publish

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.