Graylog2 / Graylog2/graylog2-server
Data Node: Allow Field Type Profiles feature to configure `dynamic` index parameter
- Dominant language
- Java
- Stars
- 8.1k
- Forks
- 1.1k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 217
Description
## What?
Data Node: Allow Field Type Profiles feature to configure `dynamic` index parameter
## Why?
Graylog inherits some challenges from OpenSearch, primarily: Soft limit of 1,000 fields per index (and increasing this is generally a bad idea)
Graylog has some useful tooling, e.g. pipeline functions, that can create a large number of fields. However, Graylog lacks tooling to help users manage fields created my ingested messages. Part of the needed tooling for monitoring field counts has been submitted via https://github.com/Graylog2/graylog2-server/issues/21775
This feature (Allowing Field Type Profiles feature to configure `dynamic` index parameter) could help with providing the user control over what fields are or are not being created and prevent indexing errors caused by field limits.
For information about this, see https://docs.opensearch.org/docs/2.19/field-types/mapping-parameters/dynamic/
Please let me know if there are any questions.
Contributor guide
Assessment
This issue has not been assessed yet.