hypothesis / hypothesis/product-backlog

Better alerting for client Sentry reports

Open
#276 1 comment 0 reactions 0 assignees View on GitHub
client Operations
Dominant language
No language data
Stars
122
Forks
7
PR merge metrics
No merged PRs in 30d

Description

The v1.14 client release was prompted by two bugs in the client which only got noticed once Sentry was deluged with so many reports that Sentry sent Nick an "Events quota exceeded" email. We should have noticed much easier.

While reacting to and manually triaging every new Sentry notification is difficult for the client for a variety of reasons, we should be able to sort out a form of alerting that does work for us - perhaps based on an uptick in the number of reports in a given time period, or if the number of users or events for a particular report exceeds some threshold.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the current Sentry reporting and notification setup, then compare alerting approaches based on report volume, user counts, and event thresholds. Done means the team has an agreed alerting approach that would surface client incidents before Sentry sends an events-quota warning.

Written by the indexing model from the issue text.

Assessment

Domain
observability
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.