canonical / canonical/layer-filebeat
exclude k8s pod logs by default Edit
- Dominant language
- Python
- Stars
- 2
- Forks
- 26
- PR merge metrics
- No merged PRs in 30d
Description
I believe the default value of exclude_files should list "^/var/log/pods" and "^/var/log/containers" in order to exclude k8s pod logs by default and keep undercloud and overcloud logging separate.
The current setting can be somewhat dangerous, as a malicious pod could try to swamp the log ingestion pipeline with an unusually high rate of log messages, which, in absence of further safeguards, would eventually consume all available space on the storage backend.
It will of course still possible to un-exclude these directories if in some environments harvesting pod logs is actually desired.
Contributor guide
Research direction
Start by locating the default exclude_files setting in the layer-filebeat charm and inspect how its value is rendered into Filebeat configuration. Confirm that /var/log/pods and /var/log/containers are excluded by default while remaining overridable. Done means the default separates Kubernetes pod logs without preventing environments from harvesting them explicitly.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- kubernetes, python
- Domain
- devops, observability-sre
- Issue type
- Feature
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 48/100