Fix copypasta in test case descriptions
- Dominant language
- C
- Stars
- 108
- Forks
- 95
- PR merge metrics
- No merged PRs in 30d
Description
### Description
We evidently have a lot of copypasta in test case descriptions. https://github.com/ARMmbed/mbedtls/pull/2843 uncovered 1420 instances of test cases that have the same description. Sometimes the reason is test descriptions that aren't fully precise and could use some additional indications such as “… using this/that algorithm” or “… with an input of this/that length”. Sometimes there are just test cases with different input data and `#1`, `#2`, … is adequate. Sometimes test cases were copied and pasted and the test data was changed but not the test description, and the description is incorrect.
https://github.com/ARMmbed/mbed-crypto/pull/270 added a disambiguator `[#1]`, `[#2]`, … to non-unique test descriptions. Not all incorrect test descriptions are formerly non-unique, but having been non-unique has a strong correlation with being imprecise or incorrect. The comments in https://github.com/ARMmbed/mbed-crypto/pull/270 contain some analysis of some of the suspicious test descriptions.
**Definition of done for this issue**: no test case description contains `[#` anymore. All the descriptions that currently contain `[#` have been edited to be corrected, or to have a plain `#` without brackets if they were correct and sufficiently precise.
I expect this to be done partly organically as we modify or expand tests, and partly by working on one module at a time.
### Issue request type
[ ] Question
[ ] Enhancement
[x] Bug
Contributor guide
Research direction
Read the analysis in mbed-crypto pull request #270 and the duplicate-description findings in Mbed TLS pull request #2843, then inspect test descriptions one module at a time. Done means no test case description contains `[#`; each affected description is corrected or uses a plain `#` when it is already precise.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- c
- Domain
- testing
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100