prometheus / prometheus/alertmanager

Send subsequent notifications to a slack thread instead of channel

Open
#3,221 16 comments 54 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

component/notify kind/enhancement
Dominant language
Go
Stars
8.6k
Forks
2.5k
Avg merge
2d 6h
Merged PRs (30d)
61

Description

What did you do?

Currently alertmanager would send an alert & resolve alert in the same way as a new message. Although when there are multiple alerts being triggered at the same time, slack channel could become messy and hard to identify which alert is being resolve and when. We'd need to scroll up and down trying to link resolve alert with initial alert triggered.

What did you expect to see?

Resolve alert should be sent into slack thread of the initial alert, this way it would make slack channel much cleaner. And it gives us better visibility on duration on mean-time-to-recover

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing Alertmanager’s Slack notification handling and how initial and resolve alerts are sent. Determine how a subsequent notification can identify the initial Slack message and be posted in its thread. Done means resolve alerts appear in the corresponding initial-alert thread while new alerts continue to post as channel messages.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.