Graylog2 / Graylog2/graylog2-server

Allow pipeline stage to connect another pipeline

Open
#4,549 2 comments 0 reactions 0 assignees View on GitHub
feature triaged
Dominant language
Java
Stars
8.1k
Forks
1.1k
Avg merge
1d 20h
Merged PRs (30d)
217

Description

I don't see this in my Github searches, so i figured I'd ask here. I ran into an issue with slookup (https://github.com/billmurrin/graylog-plugin-slookup-function/issues/9) for a specific pipeline rule that consistently failed to work (and dropped messages out of that stream to boot).

I had to work around this by separating these two when clauses into different stages, and place them into a completely separate pipeline. Due to other constraints, I had to also create a different stream to attach this pipeline to to ensure that the parsing was done before these alert condition rules.

It would be more flexible for complex conditions like these to be able to attach another pipeline to start at a specific stage of a processing pipeline rather than having to tag it into another stream to accomplish the same. Or perhaps a route_to_pipeline function that additionally begins processing the message through another pipeline (while finishing the original pipeline it's currently processing through, or even better a flag whether to continue on the original while sending it down the new pipeline or cut the original pipeline short).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.