ISISNeutronMuon / ISISNeutronMuon/MDMC

Investigate mutation testing for improved test validity

Open
#1,278 0 comments 0 reactions 0 assignees View on GitHub
P2 testing
Dominant language
Python
Stars
4
Forks
0
Avg merge
2d 4h
Merged PRs (30d)
5

Description

[Mutation testing](https://en.wikipedia.org/wiki/Mutation_testing) is a principle of "testing one's tests". In short, what it does is runs a CI test suite against a mock 'broken' version of the code; for example, it will change a `<` sign in the code to a `>` sign, a `*` to a `/`, change literal values, or change keywords like `is` to `is not`, `break` to `continue`, etc. If this 'broken' code still passes the CI tests, that suggests the tests need to be improved.

Implementing this is incredibly easy; [packages like `mutmut`](https://mutmut.readthedocs.io/) will simply run on top of pytest, both running the test suite and comparing it to a mutation test. Investigate `mutmut` for MDMC's cron testing, and see whether it provides valuable insight into the validity of our tests.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.