canonical / canonical/cos-proxy-operator

NRPE Alerts Lack Command Output

Open
#193 1 comment 0 reactions 0 assignees View on GitHub
Status: Triage Type: Enhancement
Dominant language
Python
Stars
3
Forks
12
PR merge metrics
No merged PRs in 30d

Description

### Enhancement Proposal

The NRPE alerts that make it to Alertmanager through cos-proxy do not have the output of the nrpe check commands. This information can be useful in deciding if an alert is actionable or not.
After relating cos-proxy to loki we are now getting the nrpe-exporter logs in loki which have the output of the nrpe check commands.
Being able to craft alerts from the loki log info would be really useful.
Attached are the loki logs as well as an excerpt of the CRITICAL alerts from the nrpe-exporter journal.

[Explore-logs-2025-04-10 10_47_22.json](https://github.com/user-attachments/files/19689342/Explore-logs-2025-04-10.10_47_22.json)
[Explore-logs-2025-04-10 10_47_19.txt](https://github.com/user-attachments/files/19689341/Explore-logs-2025-04-10.10_47_19.txt)
[nrpe-exporter.log](https://github.com/user-attachments/files/19689375/nrpe-exporter.log)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the attached Loki JSON, nrpe-exporter log, and journal excerpt, then trace how NRPE alerts reach Alertmanager through cos-proxy. Determine whether the command output can be incorporated from Loki log information, and verify that the resulting alerts expose useful output for deciding whether they are actionable.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.