google-deepmind / google-deepmind/superhuman

Release ProofAutograder and AnswerAutograder Prompt template

Open
#2 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Lean
Stars
800
Forks
85
PR merge metrics
No merged PRs in 30d

Description

Hi @lmthang @dawsenhwang,

Thanks for the amazing contribution! This is Ziji from NUS, and we are intertested in using IMOBench in our ongoing ML System research project.

We notice that the prompt templates for `ProofAutograder` and `AnswerAutograder` were included in the original paper but not here. To facilitate reproduction, we think it will be helpful to include them. I will submit a seprate PR to incorperate them and hope that you may approve it.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.