anthropics / anthropics/skills
Proposal: add skill-grader — a quality-rubric evaluation skill
- 主要语言
- Python
- 星标
- 176k
- 派生
- 20.9k
- 平均合并
- 7 小时 21 分钟
- 30 天内合并 PR
- 5
描述
**Summary**
I'd like to propose adding a new skill, `skill-grader`, which evaluates other Agent Skills against a production-grade quality rubric: 3 hard gates (YAML frontmatter, SKILL.md < 500 lines, description ≤ 1024 chars) + six-dimension weighted scoring (trigger design / workflow discipline / structure / output contract / guardrails / evaluation loop), producing evidence-based reports.
**Rationale**
This repo currently covers creation (`skill-creator`), document generation (`docx`/`pdf`/`pptx`/`xlsx`), and domain examples — but has no skill that *evaluates* skill quality. A grading skill completes the loop: create → evaluate → improve. It also operationalizes the guidance in the spec (progressive disclosure, optimized descriptions, evaluation).
**Implementation**
- Self-contained: SKILL.md (~180 lines) + examples/score_evals.md (3 self-test cases)
- No external dependencies; rubric embedded inline
- MIT licensed (can relicense to Apache-2.0 to match this repo if preferred)
- Reference implementation: https://github.com/yt2102/skill-grader
**Questions**
1. Does this repo accept community-contributed skills? (No CONTRIBUTING.md found.)
2. If yes, any requirements for submission (license, tests, spec compliance)?
贡献指南
这个仓库没有索引到贡献指南
调研方向
Start by reviewing the reference implementation at https://github.com/yt2102/skill-grader and the repository's existing skill layout. Confirm how community skills, licensing, and self-tests are handled, then add SKILL.md and examples/score_evals.md with the proposed three self-test cases. Done means the skill is self-contained, follows the repository's accepted requirements, and its evaluation rubric is exercised by the examples.
由索引模型根据 Issue 内容生成。
评估
- 领域
- tooling
- Issue 类型
- 功能
- 难度
- 3/5
- 预计耗时
- 1-2 天
- 活跃度
- 冷清
- 描述清晰度
- 基本清楚
- 新手友好度
- 45/100