NatLabRockies / NatLabRockies/openstudio-server-helm

Ops: add canary rollout runbook and performance gates for web scaling changes

Open
#75 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go Template
Stars
12
Forks
24
PR merge metrics
No merged PRs in 30d

Description

Summary

We need a repeatable canary rollout workflow for performance changes (HPA/pod spread/LB annotations/probe tuning) with clear success and rollback criteria tied to page-load outcomes.

Proposed work

  • Add a rollout runbook for staged web deployment changes (1 pod -> canary -> broader rollout)
  • Define metric gates for promotion/rollback (total page load, error rate, timeout rate)
  • Provide example Helm value overlays for conservative vs aggressive rollout
  • Document post-deploy validation commands and dashboards

Acceptance criteria

  • Runbook supports dry-run and staged apply
  • Explicit rollback triggers are documented and testable
  • Promotion checklist includes measurable performance thresholds
  • Guidance aligns with current chart controls (HPA v2 behavior, PDB, anti-affinity, topology spread, LB annotations).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the current Helm chart controls for HPA v2 behavior, PDB, anti-affinity, topology spread, and load-balancer annotations. Document dry-run and staged apply steps, conservative and aggressive value overlays, validation commands, dashboards, measurable promotion thresholds, and explicit rollback triggers for page-load, error, and timeout metrics.

Written by the indexing model from the issue text.

Assessment

Tech stack
helm, kubernetes
Domain
devops, infrastructure, observability
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.