fluent / fluent/fluentd

Could fluentd provide an option delete_after_read

Open
#4,527 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Ruby
Stars
13.6k
Forks
1.4k
Avg merge
1d 3h
Merged PRs (30d)
20

Description

### Is your feature request related to a problem? Please describe.

version: fluent/fluentd-kubernetes-daemonset:v1.16.5-debian-elasticsearch8-1.0
When we use in_tail plugin to upload our file to elasticsearch, we need to delete files after uploading.
But I can not found this option such as delete_after_read in otel file-receiver.

### Describe the solution you'd like

Provide an option such as delete_after_read.

### Describe alternatives you've considered

No alternatives right now

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reading the in_tail plugin entry point and the referenced otel file-receiver behavior to understand how files are tracked and uploaded. Determine where a delete_after_read option would be configured and what happens after successful delivery. Done means the option is documented, tested, and files are deleted only after the intended upload succeeds.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, ruby
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.