Scaling limits in SpecCluster
Open
enhancement
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 778
- Avg merge
- 2h 50m
- Merged PRs (30d)
- 3
Description
Currently in dask-kubernetes it is possible to set the config `kubernetes.count.max` to a value and it will not scale beyond that point.
While working on the rewrite of dask-kubernetes to use `SpecCluster` I've not been able to find a way to do this.
Is there a new max scaling config option that I'm missing or do we need to look at adding this feature?
Contributor guide
Assessment
This issue has not been assessed yet.