google-deepmind / google-deepmind/alphageometry

question on synthetic data generation to training data

Open
#92 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.9k
Forks
572
PR merge metrics
No merged PRs in 30d

Description

After a synthetic proof is generated, how is it used as training data? For example, if a synthetic proof has _N_ auxiliary constructions between the premise statement _si_ and the conclusion statement _sN+1_, would you make multiple training data entries from this proof by taking every intermediate statement from doing one auxiliary point construction at a time? i.e. you would generate N-1 data entry from this single N-construction proof:

If each single data entry follows this format
- <_si_>< _sN+1_><_auxiliary construction i_>
- <_si+1_>< _sN+1_><_auxiliary construction i+1_>
- <_si+2_>< _sN+1_><_auxiliary construction i+2_>
- ...
- <_sN_>< _sN+1_>N>
where _si+1_ is the statements after doing _auxiliary construction i_ on <_si_>

I believe the paper says it made 100M proofs, of which 9M have at least one auxiliary construction. It later also says the fine-tuning used 9M data. How are those proofs with multiple constructions handled? I assume the transformer model only predicts one auxiliary construction at a time. I might have misunderstood this part. Please let me know if I can clarify my questions. Thanks so much for your help.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.