influxdata / influxdata/telegraf

basic data stream support for opensearch output plugin

Open
#17,010 0 comments 1 reaction 0 assignees View on GitHub
feature request
Dominant language
Go
Stars
17.8k
Forks
5.8k
Avg merge
1d 20h
Merged PRs (30d)
161

Description

### Use Case

The opensearch output plugin doesn't support data streams in opensearch yet. For metrics this is the preferred format in opensearch.

### Expected behavior

The elastic search plugin does already support it (see [this](https://github.com/influxdata/telegraf/pull/15613) PR). I suggest doing the same for opensearch, since it is a very simple change, which still enables using data streams with a predefined template.

Changes would be
- Adding a boolean config option that sets the bulkitem action to 'create' instead of 'index'.

Same limitations as the elastic plugin are in place, only works with 'manage_template' = false and 'overwrite_template' = false.

### Actual behavior

No support for data streams, currently get an error when using a predefined data streams template.

### Additional info

I already got it working locally, are you open for a PR for this functionality?

Contributor guide

Open the contributing guide

Research direction

Start by comparing the OpenSearch output plugin with the Elasticsearch implementation and the referenced PR. Add the boolean option that switches the bulk item action from index to create, preserving the stated manage_template and overwrite_template limitations; done means predefined data streams can be used without the current error.

Written by the indexing model from the issue text.

Assessment

Domain
backend
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.