Graylog2 / Graylog2/graylog2-server

Logging Slow Processing / Journal manipulation

Open
#3,965 1 comment 0 reactions 0 assignees View on GitHub
feature triaged
Dominant language
Java
Stars
8.1k
Forks
1.1k
Avg merge
1d 20h
Merged PRs (30d)
217

Description

## Expected Behavior
Having a way to identify problematic message and the possibility to remove those messages from the journal - or at least log if the processing takes to much time.

## Current Behavior
Large messages can slow down or block the processing. Currently there is no way to find out which message is the reason for that. Currently you can only wait until the messages are processed, building up a large backlog of message. Or delete the journal to remove the problematic messages (and lose messages).

## Possible Solution
After a configured limit of processing time is reach for a single message, log a message to the server.log including details like journal offset, message id etc.

Optional cancel the processing for that message after a timeout to be able to process the backlog.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.