Consider value of system tests
Open
Blocked
enhancement
Test suite
- Dominant language
- Python
- Stars
- 9
- Forks
- 9
- Avg merge
- 12d 12h
- Merged PRs (30d)
- 2
Description
Currently the system tests are really just testing the top level program as all the other functionality is well covered by unit tests. Their value should be assessed.
In particular it might be better to replace them with something more like acceptance tests which build real-world example code bases that we care about.
Resource usage may be an issue there.
Contributor guide
Research direction
Review the existing system tests and the unit-test coverage to assess what the top-level program tests add. Determine whether acceptance tests using real-world example code bases would provide better coverage, and account for their resource usage before defining the replacement scope.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- build-system, testing
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100