grafana / grafana/lambda-promtail

lambda-promtail - SQS source seems to be not working

Open
#15 1 comment 9 reactions 0 assignees View on GitHub
bug
Dominant language
Go
Stars
11
Forks
42
PR merge metrics
No merged PRs in 30d

Description

**Describe the bug**
I created a Lambda that uses Promtail's [image](https://gallery.ecr.aws/grafana/lambda-promtail) to get logs from SQS and push them to the Loki endpoint.
We have a feeling that SQS should be supported based on the source code:
https://github.com/grafana/loki/blob/ffc61fbbf4990ccb00aaed107327fd5ff4d66e82/tools/lambda-promtail/lambda-promtail/main.go#L169
But we are getting the error below from Lambda:
```
level=error caller=main.go:236 err="error processing event: event bridge event type not supported"
```
Our pipeline looks like: _Log stream > EventBridge > SQS < Lambda with Promtail > Loki_
Good to mention is that if we replace SQS with CloudWatch, then it works like a charm.

**To Reproduce**
Steps to reproduce the behavior:
1. Create SQS queue
2. Create Lambda based on the Promtail ECR image and configure it to send logs to a Loki endpoint
3. Set Lambda trigger against SQS created in step 1
4. Send some logs to SQS via EventBridge
5. Errors will appear and nothing will be sent to the Loki

**Expected behavior**
Logs are correctly processed by Lambda/Promtail and stored in Loki.

**Environment:**
- Infrastructure: Loki on EKS, AWS (Lambda, SQS, EventBridge)
- Deployment tool: Helm, FluxCD

**Screenshots, Promtail config, or terminal output**
![image](https://github.com/grafana/lambda-promtail/assets/2051154/9775ce56-e44f-40d8-b78c-64732480f471)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.