google-deepmind / google-deepmind/alphageometry
question on synthetic data generation to training data
- Dominant language
- Python
- Stars
- 4.9k
- Forks
- 572
- PR merge metrics
- No merged PRs in 30d
Description
After a synthetic proof is generated, how is it used as training data? For example, if a synthetic proof has _N_ auxiliary constructions between the premise statement _si_ and the conclusion statement _sN+1_, would you make multiple training data entries from this proof by taking every intermediate statement from doing one auxiliary point construction at a time? i.e. you would generate N-1 data entry from this single N-construction proof:
If each single data entry follows this format
- <_si_>< _sN+1_><_auxiliary construction i_>
- <_si+1_>< _sN+1_><_auxiliary construction i+1_>
- <_si+2_>< _sN+1_><_auxiliary construction i+2_>
- ...
- <_sN_>< _sN+1_>N>
where _si+1_ is the statements after doing _auxiliary construction i_ on <_si_>
I believe the paper says it made 100M proofs, of which 9M have at least one auxiliary construction. It later also says the fine-tuning used 9M data. How are those proofs with multiple constructions handled? I assume the transformer model only predicts one auxiliary construction at a time. I might have misunderstood this part. Please let me know if I can clarify my questions. Thanks so much for your help.
Contributor guide
Assessment
This issue has not been assessed yet.