elastic / elastic/package-spec

[Change Proposal] Ingest pipelines support in content packages

Open
#942 4 comments 0 reactions 0 assignees View on GitHub
discuss Team:Fleet
Dominant language
Go
Stars
20
Forks
93
Avg merge
15h 10m
Merged PRs (30d)
12

Description

Even if content packages are not thought to configure how data is ingested, there are some scenarios where ingest pipelines may be useful:
* Adapting data for other components included in content packages, what can provide some flexibility when supporting different versions or types of collectors.
* Transforms based on incoming data (not supported yet in content packages).

To properly support ingest pipelines, we would also need to:
* Ensure that auto-discovered content packages can attach their pipelines to the matching indexes or data streams. In content packages that include multiple pipelines we may need a new setting to indicate what pipeline to use when auto-discovered.
* Support mappings definition in content packages, so fields created by pipelines have proper mappings.
* Make `elastic-package test pipelines` work with content packages.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.