fluent / fluent/fluent-operator

add emitterMemBufLimit and emitterStorageType to rewriteTag

Open
#1,072 0 comments 5 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
682
Forks
328
Avg merge
2d 23h
Merged PRs (30d)
13

Description

Input pauses on high pressure in complicated configs (using rewriteTag).

"If the destination for the new records generated might face backpressure due to latency or slow network, we strongly recommend enabling the filesystem mode." (https://docs.fluentbit.io/manual/pipeline/filters/rewrite-tag)

It's better to have an ability to change emitter parameters to safe ones.

Add emitter parameters to rewriteTAg and multiline, eg:

```
- rewriteTag:
emitterName: rewrite_em
emitterStorageType: filesystem
emitterMemBufLimit: 128MB

- multiline:
emitterName: multiline_em
emitterStorageType: filesystem
emitterMemBufLimit: 128MB
```

See this PR for a possible solution:
https://github.com/fluent/fluent-operator/pull/1069

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.