gchq / gchq/sleeper

Output links to logs of failed compaction jobs in system tests

Open
#7,436 0 comments 0 reactions 0 assignees View on GitHub
system-test-module
Dominant language
Java
Stars
107
Forks
29
Avg merge
19h 46m
Merged PRs (30d)
141

Description

### User Story

As a developer of Sleeper, I want it to be as easy as possible to see why a nightly test failed, so that I can fix the problem.

### Description / Background

In most of the compaction system tests we output reports on the compaction tasks and jobs if a test fails. We would also like to find the logs for any jobs that failed or are still in progress, maybe with a limit of 10 jobs, and save them to an output folder in S3.

### Technical Notes / Implementation Details

This can be done via SystemTestReports.SystemTestBuilder.compactionTasksAndJobs, in AwsCompactionReportsDriver.

We can query CloudWatch to correlate the logs, and output them to S3.

We have code for querying CloudWatch in QueryStateStoreCommitterLogs.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.