openclaw/shellbench
View on GitHubThe agent benchmark that scores the full stack — harness, config, and model — not just the LLM. Trace-based scoring, reliability metrics, configuration diagnostics.
- Stars
- 139
- Forks
- 30
- Open beginner issues
- 0
- Indexed issues
- 7
- Avg merge
- 7m
- Merged PRs (30d)
- 6
- Dominant language
- Python
- License
- MIT
- Last GitHub push
- Sep 8, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
-
clawsweeper:fix-shape-clear clawsweeper:queueable-fix clawsweeper:source-repro impact:other issue-rating: 🦞 diamond lobster no-stale P2
Difficulty 3/5 1-2 days Newbie friendliness 68/100
openclaw/shellbench#82 · 1 comment · 1 reaction ·
-
Proposal: map TaskDefinition/TaskRunResult/BenchmarkResult onto EvalPort's TestCase/Result/ResultSet Openclawsweeper:needs-maintainer-review clawsweeper:needs-product-decision clawsweeper:no-new-fix-pr issue-rating: 🌊 off-meta tidepool P3
Difficulty 5/5 Over a week Newbie friendliness 38/100
openclaw/shellbench#69 · 2 comments · 1 reaction ·
-
clawsweeper:needs-maintainer-review clawsweeper:needs-product-decision clawsweeper:no-new-fix-pr issue-rating: 🌊 off-meta tidepool P3
Difficulty 5/5 Over a week Newbie friendliness 25/100
openclaw/shellbench#68 · 2 comments · 1 reaction ·
-
clawsweeper:linked-pr-open clawsweeper:no-new-fix-pr clawsweeper:source-repro impact:other issue-rating: 🦞 diamond lobster P2
Difficulty 4/5 3-5 days Newbie friendliness 55/100
openclaw/shellbench#61 · 1 comment · 1 reaction ·
-
clawsweeper:linked-pr-open clawsweeper:needs-product-decision clawsweeper:no-new-fix-pr impact:other issue-rating: 🌊 off-meta tidepool P3
Difficulty 4/5 3-5 days Newbie friendliness 48/100
openclaw/shellbench#59 · 1 comment · 1 reaction ·
-
clawsweeper:linked-pr-open clawsweeper:needs-product-decision clawsweeper:needs-security-review clawsweeper:no-new-fix-pr impact:other impact:security issue-rating: 🌊 off-meta tidepool P2
Difficulty 5/5 Over a week Newbie friendliness 45/100
openclaw/shellbench#56 · 1 comment · 1 reaction ·
-
clawsweeper:needs-maintainer-review clawsweeper:needs-product-decision clawsweeper:no-new-fix-pr clawsweeper:source-repro impact:other issue-rating: 🦞 diamond lobster P2
Difficulty 3/5 1-2 days Newbie friendliness 72/100
openclaw/shellbench#37 · 3 comments · 2 reactions ·