EpistasisLab / EpistasisLab/tpot
TPOT stuck at 75th generation with no errors
- Dominant language
- Jupyter Notebook
- Stars
- 10.1k
- Forks
- 1.6k
- PR merge metrics
- No merged PRs in 30d
Description
I am running the GPU-accelerated (using dask) configuration of TPOT (TPOT version 0.11.7) on a couple of different data. I am also using TPOT cuML in the configuration. I am using python 3 with anaconda.
For all the data, TPOT is getting stuck at generation 74 or 75, no matter the size of the databases (some of them are 480 rows, 10 columns, up to 9000 rows, 83 columns). No error is output, the periodic checkpoint folder just stops updating, and no new messages appear. I have left it running but after 8 hours nothing new came up.
I have changed the random seed of the TPOT regressor to see if it would be an issue with a specific model architecture, but changing the seed still results in it getting stuck at generation 75.
My tpot regressor looks as follows:
tpot = TPOTRegressor(verbosity=2,
use_dask = True,
n_jobs=-1,
cv=5,
random_state=42, #this was changed, as mentioned above
template='Regressor',
config_dict='TPOT cuML',
periodic_checkpoint_folder='../checkpoints/{}/'.format(target),
max_time_mins = None
)
Any idea how to solve this issue/ why it would be happening every time for different data?
Thank you!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.