EpistasisLab / EpistasisLab/tpot

Tpot affects the nb of jobs at import

Open
#1,346 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
10.1k
Forks
1.6k
PR merge metrics
No merged PRs in 30d

Description

Hi,

when importing tpot on my linux machine the nb of effective joblib jobs is reduced to 1
the issue is not happening on the windows machine

## Process to reproduce the issue
```
import sys
import platform
print({
"python_version": platform.python_version(),
"python_implementation": platform.python_implementation(),
"platform": platform.platform(),
"system": platform.system(),
"architecture": platform.architecture(),
"processor": platform.processor(),
})
import joblib
print('joblib.__version__', joblib.__version__)
from joblib import effective_n_jobs
print('step1 logic_processors n_jobs = ', effective_n_jobs(n_jobs=-1))
import tpot
print('tpot.__version__', tpot.__version__)
print('step2 logic_processors n_jobs = ', effective_n_jobs(n_jobs=-1))
assert effective_n_jobs(n_jobs=-1) > 1

```
## Expected result

output on windows machine (no problem):

```
{'python_version': '3.11.4', 'python_implementation': 'CPython', 'platform': 'Windows-10-10.0.19045-SP0', 'system': 'Windows', 'architecture': ('64bit', 'WindowsPE'), 'processor': 'Intel64 Family 6 Model 140 Stepping 1, GenuineIntel'}
joblib.__version__ 1.3.2
step1 logic_processors n_jobs = 8
tpot.__version__ 0.12.2
step2 logic_processors n_jobs = 8
```
## Current result
output on linux machine:
```
{'python_version': '3.11.5', 'python_implementation': 'CPython', 'platform': 'Linux-4.12.14-197.108-default-x86_64-with-glibc2.26', 'system': 'Linux', 'architecture': ('64bit', 'ELF'), 'processor': 'x86_64'}
joblib.__version__ 1.3.2
step1 logic_processors n_jobs = 56
tpot.__version__ 0.12.2
step2 logic_processors n_jobs = 1
Traceback (most recent call last):
File "/dss/dsshome1/0E/di35cex/shapley-data-interaction/bug.py", line 18, in
assert effective_n_jobs(n_jobs=-1) > 1
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError
```
## Possible fix
no idea

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.