elastic / elastic/apm-data

review truncating otel strings that are indexed as keywords

Open
#125 2 comments 0 reactions 0 assignees View on GitHub
discuss
Dominant language
Go
Stars
12
Forks
31
Avg merge
8h 55m
Merged PRs (30d)
2

Description

We currently truncate otel attributes that are indexed as keywords to 1024 chars https://github.com/elastic/apm-data/blob/88a397727fd7bee5a73a9d26f8a4c9d1886abfbc/input/otlp/traces.go#L279
The mappings are generally created with `ignore_above: 1024`, which would lead to not indexing this field if the value exceeds 1024 chars.

We should review if truncating of the values for otel strings is the best choice, where the field will always be indexed, but anything above 1024 chars will be completely lost vs. not truncating the values, leading to certain fields not being indexed and searchable, but only available in `_source`, if exceeding the limit. When moving to synthetic source, the time to retrieve the non-indexed values might be increased.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.