redpanda-data / redpanda-data/benthos
`file` input deletes empty files but doesn't actually process them
Open
Nobody has claimed this yet.
bug
needs investigation
scanners
- Dominant language
- Go
- Stars
- 571
- Forks
- 120
- Avg merge
- 2d 1h
- Merged PRs (30d)
- 18
Description
For instance, try echo -n > inputs/emptyfile vs echo > inputs/newlinefile. The empty file will send the message Consuming from file 'inputs/emptyfile' to the debug logger and will delete the file, but won't actually run any processors or outputs.
Example connect config:
logger:
level: DEBUG
input:
file:
delete_on_finish: true
paths:
- inputs/*
pipeline:
processors:
- log:
message: "This won't appear for empty files!"
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the issue with the emptyfile and newlinefile commands and the shown YAML configuration, then trace the file input processing path. Done means an empty file runs the configured processors and outputs before it is deleted when delete_on_finish is enabled.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- stream-processing
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100