dask / dask/distributed

ssh cluster does not close

Open
#3,420 18 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

Hi,

when starting a sshcluster via:

```python
from distributed.deploy.ssh import SSHCluster

def start_cluster():
hosts = ['localhost']
nthreads = 1
nprocs = 2
c = SSHCluster(hosts * (nprocs+1),
connect_options={"known_hosts": None},
worker_options={"nthreads": nthreads, },
scheduler_options={"port": 0, "dashboard_address": ":8787"},
)
c.scale(nprocs)
c.close()

if __name__ == '__main__':
start_cluster()
```

the scheduler and the worker are still alive even if the calling python process is finished. The dashboard is reachable and the python processes are shown in "top".

Is there another way to close the ssh cluster?

Using Linux:
distributed 2.9.1
dask 2.9.1
python 3.6.9

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.