EpistasisLab / EpistasisLab/tpot

Process was killed

Open
#1,162 7 comments 0 reactions 0 assignees View on GitHub
unconfirmed
Dominant language
Jupyter Notebook
Stars
10.1k
Forks
1.6k
PR merge metrics
No merged PRs in 30d

Description

Hi,

I tried to run the following code

```python
tpot = TPOTRegressor(generations=500, population_size=50, verbosity=2, n_jobs=16, use_dask=True)
tpot.fit(X_train, y_train)
tpot.export("tpot_{db}.py".format(db=db))
print(db, tpot.score(X_train, y_train), tpot.fitted_pipeline
```
but, after few generations, the script was killed by system (literally "killed" is the only message depicted in console).

by running **dmesg**, I got

```
[169102.053126] Out of memory: Killed process 446321 (python) total-vm:194467732kB, anon-rss:107278388kB, file-rss:0kB, shmem-rss:4kB, UID:1000 pgtables:225528kB oom_score_adj:0
[169105.064216] oom_reaper: reaped process 446321 (python), now anon-rss:0kB, file-rss:0kB, shmem-rss:4kB
```

The dataset is small (232 rows and 108 columns). A similar program in AutoSklearn consumes about 18GB ram. Is it possible that there is a memory leak?

I'm using Python=3.7.9 and tpot=0.11.7. I tried n_jobs=1, use_dask=False, but the error remains the same.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.