google / google/slo-generator

🐛 [BUG] - Synthetic Probes show a high number a 504 errors

Open
#441 7 comments 0 reactions 1 assignee Claimed by @lvaylet View on GitHub
bug
Dominant language
Python
Stars
564
Forks
88
PR merge metrics
No merged PRs in 30d

Description

### SLO Generator Version

v2.5.2

### Python Version

3.9

### What happened?

After designing synthetic probes and availability/latency SLOs in the CI environment, a lot of 504 errors started to show up in the logs, in a seemingly random pattern. As a result, the error budget is burning quite fast during the outages. The incident usually resolves itself in under 10 minutes, then shows up again later on.

### What did you expect?

No 504 errors and no timeouts when calling the SLO Generator.

### Screenshots

_No response_

### Relevant log output

_No response_

### Code of Conduct

- [X] I agree to follow this project's Code of Conduct

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.