EpistasisLab / EpistasisLab/tpot

TPOT doesnt save best pareto values in checkpoint folder

Open
#769 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
10.1k
Forks
1.6k
PR merge metrics
No merged PRs in 30d

Description

## Context of the issue

Currently when running through all the generations, the pareto "best values" gets updated as well as the best pipeline to date. However, I noticed with "periodic checkpoint folder" option that the best pareto values do not get saved over. I spent 4 days running TPOT and some of the best and simplest models - were not saved. For example, the gradient boosting model saved (with only one model) was 0.12 RMSLE but at the end of my pipeline run in the command line prompt, the RMSLE was 0.113.

## Expected result

All of the best pareto pipelines should be saved, not just the best pipeline to date

## Current result

Only the best pipeline to date is saved

## Possible fix

Also update the pareto pipelines - the best for each iteration

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.