DataTalksClub / DataTalksClub/course-management-platform

[ALERT] cmp-dev-alb-target-response-time

Open
#234 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

infra
Dominant language
Python
Stars
85
Forks
37
PR merge metrics
No merged PRs in 30d

Description

This issue was opened automatically from a CloudWatch alarm notification.

Alarm

Field Value
Name cmp-dev-alb-target-response-time
State ALARM
Changed at 2026-08-25T07:57:59.875+0000
Description ALB target p95 response time is high for CMP dev.
Reason Threshold Crossed: 2 datapoints [5.107049986271482 (25/08/26 07:50:00), 5.071076734574111 (25/08/26 07:45:00)] were greater than the threshold (5.0).
AWS account 387546586013
Region eu-west-1

Open this alarm in CloudWatch

Metric

Field Value
Namespace AWS/ApplicationELB
Metric TargetResponseTime
Dimensions TargetGroup=targetgroup/course-management-dev/e7fbcd61f2279f3a, LoadBalancer=app/course-management-shared/bd279e4cc4f97601
Statistic p95
Period 300 seconds
Evaluation periods 2
Threshold GreaterThanThreshold 5.0

Investigation

  • Check application and load-balancer logs around the state-change time.
  • Check the current service version at /api/health/.
  • Record the cause and resolution here before closing the issue.
Application logs
Field Value
Log group /ecs/course-management-dev
Suggested window 2026-08-25T07:47:59.875000+00:00 to 2026-08-25T08:02:59.875000+00:00
Investigator role arn:aws:iam::387546586013:role/cmp-alert-investigator

Open CloudWatch Logs Insights, select /ecs/course-management-dev, or use the
cmp-alert-investigator AWS CLI profile described in the infrastructure README:

aws --profile cmp-alert-investigator logs filter-log-events \
  --region eu-west-1 \
  --log-group-name /ecs/course-management-dev \
  --start-time 1787644079875 \
  --end-time 1787644979875 \
  --limit 100

Review log output for sensitive information before copying any excerpt into
this public issue.

Raw CloudWatch notification
{
  "AWSAccountId": "387546586013",
  "ActionExecutedAfterMuteWindow": false,
  "AlarmActions": [
    "arn:aws:sns:eu-west-1:387546586013:course-management-operator-alerts"
  ],
  "AlarmArn": "arn:aws:cloudwatch:eu-west-1:387546586013:alarm:cmp-dev-alb-target-response-time",
  "AlarmConfigurationUpdatedTimestamp": "2026-07-08T22:06:44.841+0000",
  "AlarmDescription": "ALB target p95 response time is high for CMP dev.",
  "AlarmName": "cmp-dev-alb-target-response-time",
  "InsufficientDataActions": [],
  "NewStateReason": "Threshold Crossed: 2 datapoints [5.107049986271482 (25/08/26 07:50:00), 5.071076734574111 (25/08/26 07:45:00)] were greater than the threshold (5.0).",
  "NewStateValue": "ALARM",
  "OKActions": [],
  "OldStateValue": "OK",
  "Region": "EU (Ireland)",
  "StateChangeTime": "2026-08-25T07:57:59.875+0000",
  "Trigger": {
    "ComparisonOperator": "GreaterThanThreshold",
    "Dimensions": [
      {
        "name": "TargetGroup",
        "value": "targetgroup/course-management-dev/e7fbcd61f2279f3a"
      },
      {
        "name": "LoadBalancer",
        "value": "app/course-management-shared/bd279e4cc4f97601"
      }
    ],
    "EvaluateLowSampleCountPercentile": "",
    "EvaluationPeriods": 2,
    "ExtendedStatistic": "p95",
    "MetricName": "TargetResponseTime",
    "Namespace": "AWS/ApplicationELB",
    "Period": 300,
    "StatisticType": "ExtendedStatistic",
    "Threshold": 5.0,
    "TreatMissingData": "notBreaching",
    "Unit": null
  }
}

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the CloudWatch logs for /ecs/course-management-dev in the suggested time window, using the cmp-alert-investigator profile described in the infrastructure README. Check the current service version at /api/health/, then record the cause and resolution in this issue before closing it; review excerpts for sensitive information first.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, django, python
Domain
backend, cloud, observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.