aws / aws/containers-roadmap

[EKS] [Fargate]: Support to Fluent Bit for EKS Fargate in a private cluster

Open
#1,254 5 comments 5 reactions 0 assignees View on GitHub
EKS Fargate Proposed
Dominant language
Shell
Stars
5.4k
Forks
334
PR merge metrics
No merged PRs in 30d

Description

### Community Note

* Please vote on this issue by adding a 👍 [reaction](https://blog.github.com/2016-03-10-add-reactions-to-pull-requests-issues-and-comments/) to the original issue to help the community and maintainers prioritize this request
* Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
* If you are interested in working on this issue or have submitted a pull request, please leave a comment

**Tell us about your request**
What do you want us to build?
Configure Fluent Bit for EKS Fargate in a private cluster

**Which service(s) is this request for?**
Fargate, EKS

**Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?**
I have tried to configure Fluent Bit for EKS Fargate[1] in a private cluster[2]. Despite the required VPC endpoints exist and accessible by the pods and also the events of the new pods show that logging is enabled, the log group is not created.

It only seems to work when a NAT Gateway (internet connection) is associated with the route tables of the subnets,

**Are you currently working around this issue?**
Sidecar containers seems to be the valid workaround for the timebeing

Reference:
[1] https://aws.amazon.com/blogs/containers/fluent-bit-for-amazon-eks-on-aws-fargate-is-here/
[2] https://docs.aws.amazon.com/eks/latest/userguide/private-clusters.html

Contributor guide

Open the contributing guide

Research direction

No repository files or tests are named. Start with the linked Fluent Bit for EKS Fargate and private-cluster references, then investigate why logging works with a NAT Gateway but not the listed VPC endpoints; done means Fluent Bit creates the log group and delivers logs in a private cluster without internet access.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, kubernetes
Domain
cloud, infrastructure, observability
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.