ComplianceAsCode / ComplianceAsCode/auditree-arboretum

Persistent failure report

Open
#71 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
22
Forks
12
PR merge metrics
No merged PRs in 30d

Description

## Overview

It would be good to have a report that highlights persistent failures - checks that consistently fail for many days.

## Requirements

- configurable threshold for persistent failure, measured in time
- report is a list of check, time period of failure pairs & last successful run (`check foo has been failing for 8 days, last successful run $TIMESTAMP`)
- if we were clever, could extend to flapping tests...

## Approach

Write a report in https://github.com/ComplianceAsCode/auditree-arboretum/tree/main/arboretum/auditree/reports

## Security and Privacy

N/A

## Test Plan

Will need some fake result data to demonstrate persistent failure.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.