starting dask.distributed.Client with default settings results in endless restarting of workers
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 778
- Avg merge
- 2h 50m
- Merged PRs (30d)
- 3
Description
**What happened**:
- starting Client locally with default settings results in endless restarting of workers (with processes=True)
- Note: this happened after updating my conda environment from Dask 2021.3.0 and Python 3.8.8 (it was ok with these versions before)
**What you expected to happen**: for the client to start
**Minimal Complete Verifiable Example**:
This fails:
```python
from dask.distributed import Client
client = Client(processes=True)
```
This starts:
```python
from dask.distributed import Client
client = Client(processes=False)
```
**Anything else we need to know?**:
Running from Jupyter notebook
**Environment**:
- Dask version: *2022.9.0*
- Distributed version: *2022.9.0*
- Python version: *3.9.13*
- Operating System: *Windows 10*
- Install method *conda-forge*
**Error output on failing example:**
```
2022-09-14 09:17:43,926 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,939 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,949 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,962 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,969 - distributed.nanny - WARNING - Restarting worker
Traceback (most recent call last):
File "c:\Users\myuser\Miniconda3\envs\sim\lib\site-packages\distributed\nanny.py", line 822, in _wait_until_connected
msg = self.init_result_q.get_nowait()
File "c:\Users\myuser\Miniconda3\envs\sim\lib\multiprocessing\queues.py", line 135, in get_nowait
return self.get(False)
File "c:\Users\myuser\Miniconda3\envs\sim\lib\multiprocessing\queues.py", line 116, in get
raise Empty
_queue.Empty
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "c:\Users\myuser\Miniconda3\envs\sim\lib\site-packages\distributed\utils.py", line 799, in wrapper
return await func(*args, **kwargs)
File "c:\Users\myuser\Miniconda3\envs\sim\lib\site-packages\distributed\nanny.py", line 539, in _on_worker_exit
await self.instantiate()
File "c:\Users\myuser\Miniconda3\envs\sim\lib\site-packages\distributed\nanny.py", line 438, in instantiate
result = await self.process.start()
File "c:\Users\myuser\Miniconda3\envs\sim\lib\site-packages\distributed\nanny.py", line 695, in start
msg = await self._wait_until_connected(uid)
File "c:\Users\myuser\Miniconda3\envs\sim\lib\site-packages\distributed\nanny.py", line 824, in _wait_until_connected
await asyncio.sleep(self._init_msg_interval)
File "c:\Users\myuser\Miniconda3\envs\sim\lib\asyncio\tasks.py", line 652, in sleep
return await future
asyncio.exceptions.CancelledError
2022-09-14 09:17:43,926 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,939 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,949 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,962 - distributed.nanny - WARNING - Restarting worker
2022-09-14 09:17:43,969 - distributed.nanny - WARNING - Restarting worker
...
```
Contributor guide
Assessment
This issue has not been assessed yet.