microsoft / microsoft/AzureMonitorCommunity

Deduplicating Alerts

Open
#213 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
PowerShell
Stars
1.2k
Forks
493
PR merge metrics
No merged PRs in 30d

Description

Hi team, currently I have this setup:

  • Prometheus rule group with scope of Azure Monitor Workspace
  • The rules in the rule group have an action group associated, which will call a HTTP based slack webhook to send alerts

What I'm trying to achieve:

  • When the condition is met for a certain rule, I expected the alert to fire once and subsequent evaluations to the rule to either do nothing or update to the existing alert

Current reality of my setup:

  • When the condition is met for a certain rule, new alerts will keep firing on each subsequent evluation of the rule

I've tried looking for configuration that will help me achieve the desired behavior but with no luck.
So far I've tried:

  • Setting the evaluation interval to a higher value, but this only delays the alert firing, not deduplicate it
  • Processing rule to supress alerts, but it seems to only supress by time of day etc, not deduplicate

Is there a config that I'm not aware of or is this a mechanism not yet implemented in Azure Monitor?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing Azure Monitor Prometheus alert evaluation and notification behavior for the described rule group and Slack webhook setup. Determine whether alert deduplication or updating existing alerts is supported, and document the relevant configuration or confirm that the capability is not implemented.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, prometheus
Domain
cloud, observability
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.