Output links to logs of failed compaction jobs in system tests
- Dominant language
- Java
- Stars
- 107
- Forks
- 29
- Avg merge
- 19h 46m
- Merged PRs (30d)
- 141
Description
### User Story
As a developer of Sleeper, I want it to be as easy as possible to see why a nightly test failed, so that I can fix the problem.
### Description / Background
In most of the compaction system tests we output reports on the compaction tasks and jobs if a test fails. We would also like to find the logs for any jobs that failed or are still in progress, maybe with a limit of 10 jobs, and save them to an output folder in S3.
### Technical Notes / Implementation Details
This can be done via SystemTestReports.SystemTestBuilder.compactionTasksAndJobs, in AwsCompactionReportsDriver.
We can query CloudWatch to correlate the logs, and output them to S3.
We have code for querying CloudWatch in QueryStateStoreCommitterLogs.
Contributor guide
Assessment
This issue has not been assessed yet.