Application unittests using utils_test.cluster() timeout on Windows
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 778
- Avg merge
- 2h 50m
- Merged PRs (30d)
- 3
Description
My application's distiributed unittests always seem to fail on Windows due to the timeout set in the below line. They work fine on Linux. I tried changing it to 15s on Windows and it worked fine. Can this timeout be increased or made configurable for cases where it takes longer to create a worker process?
https://github.com/dask/distributed/blob/538767b4977d1bd14679ae555b7705088a7e5a16/distributed/utils_test.py#L653
**Code:**
```python
scheduler_kwargs = {
'preload': (,),
'preload_argv': (,),
}
worker_kwargs = {
'preload': (,),
'preload_argv': (,),
'ncores': 1,
'memory_limit': 70000000000,
}
with distributed.utils_test.cluster(nworkers=1, nanny=True, worker_kwargs=worker_kwargs, scheduler_kwargs=scheduler_kwargs) as (s, ws):
```
**Exception:**
```
Traceback (most recent call last):
File "\lib\site-packages\distributed\utils_test.py", line 653, in cluster
worker['address'] = worker['queue'].get(timeout=5)
File "\lib\multiprocessing\queues.py", line 105, in get
raise Empty
queue.Empty
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
...
File "\lib\contextlib.py", line 59, in __enter__
return next(self.gen)
File "\lib\site-packages\distributed\utils_test.py", line 655, in cluster
raise pytest.xfail.Exception("Worker failed to start in test")
_pytest.outcomes.XFailed: Worker failed to start in test
```
Python 3.5.6
distributed 1.25.1
Contributor guide
Assessment
This issue has not been assessed yet.