dask / dask/distributed

Application unittests using utils_test.cluster() timeout on Windows

Open
#2,438 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

My application's distiributed unittests always seem to fail on Windows due to the timeout set in the below line. They work fine on Linux. I tried changing it to 15s on Windows and it worked fine. Can this timeout be increased or made configurable for cases where it takes longer to create a worker process?
https://github.com/dask/distributed/blob/538767b4977d1bd14679ae555b7705088a7e5a16/distributed/utils_test.py#L653

**Code:**
```python
scheduler_kwargs = {
'preload': (,),
'preload_argv': (,),
}
worker_kwargs = {
'preload': (,),
'preload_argv': (,),
'ncores': 1,
'memory_limit': 70000000000,
}
with distributed.utils_test.cluster(nworkers=1, nanny=True, worker_kwargs=worker_kwargs, scheduler_kwargs=scheduler_kwargs) as (s, ws):

```

**Exception:**
```
Traceback (most recent call last):
File "\lib\site-packages\distributed\utils_test.py", line 653, in cluster
worker['address'] = worker['queue'].get(timeout=5)
File "\lib\multiprocessing\queues.py", line 105, in get
raise Empty
queue.Empty

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
...
File "\lib\contextlib.py", line 59, in __enter__
return next(self.gen)
File "\lib\site-packages\distributed\utils_test.py", line 655, in cluster
raise pytest.xfail.Exception("Worker failed to start in test")
_pytest.outcomes.XFailed: Worker failed to start in test
```

Python 3.5.6
distributed 1.25.1

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.