dask / dask/distributed

Distributed's Adaptive's Scheduler `retire_workers` and Cluster `scale_down`

Open
#1,951 9 comments 0 reactions 0 assignees View on GitHub
adaptive
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

It appears that [Distributed's Adaptive tells the Scheduler to `retire_workers` and then `scale_down` the Cluster]( https://github.com/dask/distributed/blob/1.21.7/distributed/deploy/adaptive.py#L230-L235 ). Is there a reason both of these operations are needed? Also what does this mean for downstream libraries inheriting from Distributed's Adaptive or Distributed's Cluster?

xref: https://github.com/dask/dask-drmaa/issues/65 (for context)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.