fluent / fluent/fluentd

Regex support for exclude_path

Open
#3,793 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Ruby
Stars
13.6k
Forks
1.4k
Avg merge
1d 3h
Merged PRs (30d)
20

Description

### Is your feature request related to a problem? Please describe.

Pertaining to the issue raised under [https://github.com/fluent/fluentd/issues/3792](url) would like to request a new regex pattern to filter logs based on date as rotated log files are renamed to name-Pod IP-**YYYY-MM-DD**.log which needs to be skipped

### Describe the solution you'd like

To introduce a regex pattern for exclude_path for filtering out log files containing date in the log file name. Refer below samples.

Sample rotated log file name:
dms-shopping-cart-ms-10.35.67.106-**2022-06-20**.log

exclude_path config:

`exclude_path ["/data/logs/*/app/*-%Y-%m-%d.log"]`

### Describe alternatives you've considered

N/A

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

The request concerns Fluentd's exclude_path configuration and the date-containing rotated filenames described here; first read issue 3792 for the related behavior and trace where exclude_path patterns are parsed and matched. Confirm the supported pattern semantics against the sample path, then add coverage for the requested configuration and verify that matching rotated files are skipped.

Written by the indexing model from the issue text.

Assessment

Tech stack
ruby
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.