gitcoinco / gitcoinco/web

Add Monitors in Datadog for Pager Duty

Open
#10,735 0 comments 0 reactions 2 assignees Claimed by @kevinrolsen View on GitHub
cGrants GR15
Dominant language
JavaScript
Stars
1.8k
Forks
776
PR merge metrics
No merged PRs in 30d

Description

**Acceptance Criteria**
Add Monitors for the following (this list is WIP):

- [x] High number of 500s
- [ ] High Number of instances (indicates Autoscaling is working, but consuming too many resources)
- [x] High Latency on Page Load (indicates overall site performance degradation)
- [ ] High number of jobs enqueued in Redis (indicates celery workers aren't keeping up with demand)
- [x] Synthetic pageload tests failing (canary uptime test)

- [ ] Ensure Read Replica DBs are also monitored
- [x] High Mem on DBs
- [x] High CPU on DBs (DB load is a known bottleneck, may need to find and kill long running queries)
- [x] High Latency on DB Querries (indicates inefficient queries, or high db load)
- [x] High CPU on cluster (indicates Autoscaling is lagging behind demand)

**XD Links:**

**Tech Details:**

**Open Questions:**

**Notes/Assumptions:**

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.