ipython / ipython/ipyparallel

Proper shutdown for dask.distributed

Aperta
#265 3 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Jupyter Notebook
Stelle
2.6k
Fork
1k
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

When using the [`stop_dask` method]( http://ipyparallel.readthedocs.io/en/latest/api/ipyparallel.html#ipyparallel.Client.stop_dask ) of the `ipyparallel.Client`, the following warning message pops up.

```
distributed.client - WARNING - Client report stream closed to scheduler
```

However, if I run [`shutdown`]( http://distributed.readthedocs.io/en/latest/api.html#distributed.client.Client.shutdown ) on the Dask client provided by [`become_dask`]( http://ipyparallel.readthedocs.io/en/latest/api/ipyparallel.html#ipyparallel.Client.become_dask ), and then run `stop_dask`, the warning goes away.

Looking at the [code in ipyparallel]( https://github.com/ipython/ipyparallel/blob/6.0.2/ipyparallel/client/client.py#L1334 ) it is not obvious how it would handle calling `shutdown` as it does not know the Dask client in `stop_dask`. However it does seem `shutdown` needs to be called on the `executor`. How exactly should shutdown be done with `dask.distributed`?

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.