Collate processor

Is your feature request related to a problem? Please describe.

Pipeline users need an option to collate/compare by specifying criteria needed. A scenario is to know query performance between two clusters.

Describe the solution you'd like

Create a processor which would take inputs on what needs to be collated. For Instance, receive streaming logs containing details of live query which is happening on source cluster and pipeline will execute the same query on destination cluster.

Processor will able to read queries/derive from received logs and queue the query on destination cluster. While pipeline is running on other destination cluster , I would envision processor should be able to run user defined comparisons , generate latency , compare metrics or logs.

source:
    - collate:
        destination_cluster_node_id: "50855at-856-896545"
        query: ""
        api: ""
        schedule: " ***** "

Additional context

No file, test, or entry point is named. Start by examining the existing processor and pipeline extension points, then clarify how source logs, destination clusters, queries, APIs, schedules, and user-defined comparisons should be represented; done should include an agreed scope and acceptance criteria for collated performance or metric results.