Graylog2 / Graylog2/graylog2-server

Data Node: Allow Field Type Profiles feature to configure `dynamic` index parameter

Open
#22,971 0 comments 0 reactions 0 assignees View on GitHub
feature triaged
Dominant language
Java
Stars
8.1k
Forks
1.1k
Avg merge
1d 20h
Merged PRs (30d)
217

Description

## What?

Data Node: Allow Field Type Profiles feature to configure `dynamic` index parameter

## Why?

Graylog inherits some challenges from OpenSearch, primarily: Soft limit of 1,000 fields per index (and increasing this is generally a bad idea)

Graylog has some useful tooling, e.g. pipeline functions, that can create a large number of fields. However, Graylog lacks tooling to help users manage fields created my ingested messages. Part of the needed tooling for monitoring field counts has been submitted via https://github.com/Graylog2/graylog2-server/issues/21775

This feature (Allowing Field Type Profiles feature to configure `dynamic` index parameter) could help with providing the user control over what fields are or are not being created and prevent indexing errors caused by field limits.

For information about this, see https://docs.opensearch.org/docs/2.19/field-types/mapping-parameters/dynamic/

Please let me know if there are any questions.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.