Graylog2 / Graylog2/graylog2-server

Expose processing latency

Open
#16,163 1 comment 1 reaction 1 assignee Claimed by @kroepke View on GitHub
feature triaged
Dominant language
Java
Stars
8.1k
Forks
1.1k
Avg merge
1d 20h
Merged PRs (30d)
217

Description

## What?
When Graylog receives messages, it records the message content and metadata in the journal for later stages to pick them up.
Due to external factors, such as load spikes, network constraints, or other downstream indexing issues, there can be a significant delay between when a message has been delivered to the server vs when it is sent off to indexing it.

This per-server processing latency is important to users and operators to understand the state and health of a system.

The alerting system already considers processing latency, but it is probably not properly exposed to users yet.

## Why?
If the processing latency is very high, recent data received by Graylog servers won't be available for searching; thus, while the system is catching up, searches over recent time frames will not be accurate. Users need to be aware of this.

For operators, high processing latency can help when measuring a cluster or individual servers' health (current or future).

## Your Environment

* Graylog Version: 5.1
* OpenSearch Version: N/A
* MongoDB Version: N/A
* Operating System: N/A
* Browser version: N/A

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.