[Feature] Allow a configurable delay between node upgrades to ensure pods have enough time to recover during upgrades.
- Dominant language
- TypeScript
- Stars
- 2.1k
- Forks
- 395
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 13
Description
**Is your feature request related to a problem? Please describe.**
Whenever we upgrade aks to a new k8s version that has a windows nodepool the upgrade replaces nodes faster than the pods can recover in. This usually results in a total complete outage of the entire cluster for 20 minutes in production, which is very impactful and hard to work around.
**Describe the solution you'd like**
I would like a way to build in a wait between moving to a new node so that the pods on that node can recover. This really only affects windows images on windows nodes as the delay is mostly around the size of the image itself.
**Describe alternatives you've considered**
We have reviewed the node surge upgrade features, but the default settings are already the slowest that we can see. If we bump it higher it will just be more aggressive in taking more nodes down the moment the previous nodes are healthy from a k8s perspective.
**Additional context**
Add any other context or screenshots about the feature request here.
Contributor guide
Assessment
This issue has not been assessed yet.