leanprover / leanprover/lean-eval
formal-conjectures integration
Nobody has claimed this yet.
- Dominant language
- Lean
- Stars
- 46
- Forks
- 39
- Avg merge
- 54m
- Merged PRs (30d)
- 80
Description
Just opening this issue to track discussions and work related to the integrating problem sets from formal-conjectures into Lean eval.
I think one good place to start would be the FC100SolvedSet1 and FC100OpenSet1 (100 open and solved problems - there will be more releases of such sets in the future!). The subsets can be found here
Currently the idea seems to be:
- Since these are all open problems (rather than already known theorems) they should go in a separate tab
- Unlike solved problems, making solutions public should be part of the conditions for submission of a solution.
Link to discussion on the Lean Zulip.
I'm planning on working on (prototyping) this integration, but any pointers to get started would be helpful @kim-em!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the existing Lean eval integration for solved problems, then inspect the FC100SolvedSet1 and FC100OpenSet1 subsets in FormalConjectures/Subsets and read the linked Zulip discussion. Done means the formal-conjectures problem sets are integrated into a separate tab, with public solutions required for submissions.
Written by the indexing model from the issue text.
Assessment
- Domain
- testing-qa
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100