ipython / ipython/ipyparallel

Proper shutdown for dask.distributed

Abierto
#265 3 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Jupyter Notebook
Estrellas
2.6k
Forks
1k
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

When using the [`stop_dask` method]( http://ipyparallel.readthedocs.io/en/latest/api/ipyparallel.html#ipyparallel.Client.stop_dask ) of the `ipyparallel.Client`, the following warning message pops up.

```
distributed.client - WARNING - Client report stream closed to scheduler
```

However, if I run [`shutdown`]( http://distributed.readthedocs.io/en/latest/api.html#distributed.client.Client.shutdown ) on the Dask client provided by [`become_dask`]( http://ipyparallel.readthedocs.io/en/latest/api/ipyparallel.html#ipyparallel.Client.become_dask ), and then run `stop_dask`, the warning goes away.

Looking at the [code in ipyparallel]( https://github.com/ipython/ipyparallel/blob/6.0.2/ipyparallel/client/client.py#L1334 ) it is not obvious how it would handle calling `shutdown` as it does not know the Dask client in `stop_dask`. However it does seem `shutdown` needs to be called on the `executor`. How exactly should shutdown be done with `dask.distributed`?

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.