google-deepmind / google-deepmind/superhuman

Add Level column to IMO-AnswerBench

Open
#4 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Lean
Stars
800
Forks
85
PR merge metrics
No merged PRs in 30d

Description

Can the Level column (pre-IMO, IMO-easy, IMO-medium, IMO-hard) be added to IMO-AnswerBench, similar to how it is in IMO-ProofBench?

The paper lists the difficulty breakdown for each problem category in Table 2, but it would be useful to have it at a per-problem granularity.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.