dask / dask/distributed

`SubprocessCluster` and `SSHCluster` hang indefinitely when using the new-style logging configuration

Open
#8,392 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

When using the new-style logging configuration, both the `SSHCluster` and the `SubprocessCluster` hang indefinitely because they rely on a stream handler registered to `distributed` on `INFO` level to write the scheduler address to `stderr`.

This can be reproduced by using new-style logging configuration in your Dask configuration file, e.g. your config may look like
```yaml
distributed:
version: 2
logging:
version: 1
```
and starting a cluster.

With the old-style logging configuration this works as expected due to #8391.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.