ISISComputingGroup / ISISComputingGroup/IBEX

Tabulate ioc test failures

Open
#6,739 2 comments 0 reactions 0 assignees View on GitHub
5 Friday
Dominant language
No language data
Stars
6
Forks
2
Avg merge
16h 40m
Merged PRs (30d)
2

Description

As a developer I would like a table of when ioc tests are failing so i can determine which are failing frequently and need attention. Some work has been done in https://github.com/ISISComputingGroup/ibex_utils/blob/master/developer_support_script/check_build_stability.py that can be used as a basis

## Acceptance criteria

* Test output of System_tests, System_tests_debug and System_tests_win10 builds is parsed
* a table is generated of ioc name v system test type with the cell containing failing build numbers
* need to decide how many historic builds to go back
* job is ran periodically e.g. by jenkins and output available for reading e.g. at standup
* may be possible to get jenkins to graph or do something nice e.g. if you made the above table generation like output of running unit tests, jenkins could plot number of test failures over time maybe. Not sure what is possible, but worth a look.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.