Ensembling: train the pipelines and the metalearner on different data
Open
enhancement
performance
- Dominant language
- Python
- Stars
- 850
- Forks
- 96
- PR merge metrics
- No merged PRs in 30d
Description
This issue tracks:
* During automl search, first train each pipeline on full 80% automl training split, then generate predictions on 20% ensemble split, and use those predictions to train the metalearner on that 20% ensemble split using CV.
* For refitting best pipeline, if the best pipeline was non-ensemble, train on entire 100% (should already be the case). If best pipeline was ensemble, same as above: first train each pipeline on full 80% automl training split, then generate predictions on 20% ensemble split, and use those predictions to train the metalearner on that 20% ensemble split.
Contributor guide
Assessment
This issue has not been assessed yet.