fluent / fluent/fluent-bit

Active watches on kube apiserver in kubernetes filter plugin

Open
#1,162 3 comments 8 reactions 0 assignees View on GitHub
enhancement
Dominant language
C
Stars
8.1k
Forks
2k
Avg merge
4d 20h
Merged PRs (30d)
71

Description

**Is your feature request related to a problem? Please describe.**
In_tail plugin has latency checking logs from containers (files discovery). When pod/container fails to start, the moment event reaches filter plugin there can be no longer pod metadata in apiserver.

**Describe the solution you'd like**
Plugin can open watch on pods in apiserver and store them in local cache. There won't be situation when fluent-bit (plugin) won't know about pod.

**Describe alternatives you've considered**

**Additional context**
This was already introduced in https://github.com/fabric8io/fluent-plugin-kubernetes_metadata_filter and is enabled by default (`watch` property)

Contributor guide

Open the contributing guide

Research direction

Start by locating the Kubernetes filter plugin and its pod-metadata lookup path; the issue does not name files or tests. Review the upstream fluent-plugin-kubernetes_metadata_filter watch behavior referenced in the issue, then determine how an active pod watch and local cache should cover metadata missing when a container-start event arrives. Done means the plugin retains and uses pod metadata in that case.

Written by the indexing model from the issue text.

Assessment

Tech stack
c, kubernetes
Domain
devops
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.