ipython / ipython/ipyparallel

Proper shutdown for dask.distributed

Ouverte
#265 3 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Jupyter Notebook
Étoiles
2.6k
Forks
1k
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

When using the [`stop_dask` method]( http://ipyparallel.readthedocs.io/en/latest/api/ipyparallel.html#ipyparallel.Client.stop_dask ) of the `ipyparallel.Client`, the following warning message pops up.

```
distributed.client - WARNING - Client report stream closed to scheduler
```

However, if I run [`shutdown`]( http://distributed.readthedocs.io/en/latest/api.html#distributed.client.Client.shutdown ) on the Dask client provided by [`become_dask`]( http://ipyparallel.readthedocs.io/en/latest/api/ipyparallel.html#ipyparallel.Client.become_dask ), and then run `stop_dask`, the warning goes away.

Looking at the [code in ipyparallel]( https://github.com/ipython/ipyparallel/blob/6.0.2/ipyparallel/client/client.py#L1334 ) it is not obvious how it would handle calling `shutdown` as it does not know the Dask client in `stop_dask`. However it does seem `shutdown` needs to be called on the `executor`. How exactly should shutdown be done with `dask.distributed`?

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.