dask / dask/distributed

Worker process dying unexpectedly should not result in a zero exit code

Open
#7,971 3 comments 1 reaction 0 assignees View on GitHub
bug
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

I'm seeing this in the logs
```
distributed.nanny - INFO - Closing Nanny gracefully at 'tls://xx'. Reason: worker-handle-scheduler-connection-broken
```

but the nanny process is returning a 0 exit code. This very much feels like it should return a non-zero exit code. Otherwise we can't really differentiate between dask workers that are exiting for sad reasons , and those that are just responding to a sigterm or scheduler scale down request.

Best case the nanny should exit with a variety of documented exit codes depending on the bad exit condition. Next best case pick an exit code and use that for every 'bad' exit.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.