Graylog2 / Graylog2/graylog-plugin-beats

Support back pressure protocol

Open
#27 0 comments 7 reactions 0 assignees View on GitHub
feature triaged
Dominant language
Java
Stars
18
Forks
16
PR merge metrics
No merged PRs in 30d

Description

According to elastic, "Filebeat uses a backpressure-sensitive protocol when sending data to Logstash or Elasticsearch to account for higher volumes of data. If Logstash is busy crunching data, it lets Filebeat know to slow down its read."
More info here:
https://www.elastic.co/guide/en/logstash/current/persistent-queues.html#backpressure-persistent-queue

I searched through the graylog-plugin-beats code and didn't find any reference to it, and my testing indicates its not supported.

This would be useful to prevent Graylog from having its journal maxed out and having it crash if filebeats starts shipping more logs than Graylog can handle.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.