prometheus / prometheus/alertmanager

[FEATURE REQUEST] Alertmanager receiver for Suppressed Alerts

Open
#4,120 2 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

component/silences kind/enhancement
Dominant language
Go
Stars
8.6k
Forks
2.5k
Avg merge
2d 6h
Merged PRs (30d)
61

Description

Problem Statement

Currently, Alertmanager does not expose metrics for silenced alerts, making it difficult to track them without manually navigating to the Alertmanager UI. Also, polling the /silences endpoint to know what alerts are silenced is inconvenient. The issue is better solved upstream on alertmanager side.

Proposed Solution

Add an optional suppressed receiver for an alert matcher: For an alert that matches an alertmanager route and has some sort of suppress configured, Alertmanager will hit the suppressed receiver instead when alert.state is suppressed. Otherwise, no-ops. This implementation is simple as there are existing egress mechanisms doing this for firing state.

Example Scenario

During a planned maintenance window, an alert is silenced. The new egress mechanism will notify a new receiver responsible for handling silences. This is very useful for critical services undergoing maintenance and require silencing to take further actions.

Benefits

  • Automated Notifications
  • Improved Visibility
  • Efficient Monitoring
  • Allows Auditing

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing Alertmanager’s existing egress mechanisms and the /silences endpoint described in the issue. Trace how a route matcher handles firing alerts and how alert.state represents suppressed; the feature is done when an optional suppressed receiver can handle matching silenced alerts without changing the normal path.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
observability-sre
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.