DiamondLightSource / DiamondLightSource/blueapi

Implement standardised debug logs

Open
#1,176 5 comments 0 reactions 0 assignees View on GitHub
monitoring
Dominant language
Python
Stars
13
Forks
13
Avg merge
2d 11h
Merged PRs (30d)
25

Description

We currently don't have a standard way to store useful debug logs in an easily-accessible way. Requirements are:
1. Our pod should be able to spew out a lot of debug logs without affecting deletion rate of the info-and-greater logs
2. Debug logs are treated as ephemeral until an exception occurs and are then persisted surrounding an exception (e.g. plus or minus 1 hour). This is purely to save storage space
3. Those logs around an exception should be kept for as long as it takes for the exception cause to be identified. This is perhaps 4-5 days as a top end.

Alternatively, we could just get extra storage space and keep all debug logs for ~5 days. At a rough guess this would be <2TB for all 30 beamlines

See https://github.com/DiamondLightSource/mx-bluesky/issues/1213 for original discussion

## Acceptance Criteria
- Debug logs which meet above requirements are implemented

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.