dask / dask/distributed

[DRAFT] Move adaptive scaling functionality into dedicated process

Open
#6,907 7 comments 0 reactions 0 assignees View on GitHub
adaptive discussion enhancement
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

**Problem**
With adaptive scaling being executed on the client-side, it's easy to execute multiple (possibly mutually-exclusive) adaptive scaling policies on a single distributed cluster through the use of multiple `Cluster` objects.

**Goal**
At any given moment, there should be one, and only one, adaptive scaling policy in place that is being applied to the distributed cluster (not `Cluster` object).

Additional benefits:
* simplifies the client-side
* allows clients to query and modify the adaptive scaling policy another one has put into place

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.