open-telemetry / open-telemetry/opentelemetry-python-contrib
Include Sigv4 authentication on remote write exporter to directly send metrics to Amazon Managed Prometheus
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 1.1k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 16
Description
Describe the solution you'd like
I want to add monitoring for my Python applications hosted on aws (EC2, Beanstalk), and the decision was to go with Prometheus. Since we already extensively use AWS, we want to use Amazon Managed Prometheus service (AMP), which is supposed to be easier to scale because it's a serverless approach and aws handles the scaling. The problem I see is that even though we can use AMP, we still would have to host a Prometheus server and set up service discovery, since our instances are dynamic and some are short lived jobs, which does not seem trivial and it might not work easily for our infrastructure.
AMP has a remote write endpoint and what I have in mind is that we could simply generate the prometheus metrics in our flask application and push the metrics directly to AMP, without having to set up a prometheus server. Correct me if I'm wrong, please, I'm kind of new to this. This package does not support the Sigv4 authentication method used in AWS, so I think if that was the case, my idea could work and it would be a very simple way to create an AMP workspace and simply push metrics to it (Does that make sense?).
Thanks!
Describe alternatives you've considered
Which alternative solutions or features have you considered?
Additional context
Add any other context about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files or tests. Start by locating the remote write exporter and its authentication path, then review the SigV4 requirements for Amazon Managed Prometheus. Done means the exporter can send metrics directly to an AMP remote write endpoint using SigV4 authentication.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, prometheus, python
- Domain
- cloud, observability-sre
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100