test/integ: parameterize, parallelize integ tests
- Dominant language
- TypeScript
- Stars
- 2k
- Forks
- 807
- Avg merge
- 10h 12m
- Merged PRs (30d)
- 7
Description
## Problem:
integ tests are slow. and some of them (Java debug) are hard to cleanup, or interfere with each other.
## Solution
- add a parameter to the test runner that selects specific integ tests (including permutations of the test in `src/integrationTest/sam.test.ts`
- in our CI [buildspec](https://github.com/aws/aws-toolkit-vscode/blob/master/buildspec/linuxIntegrationTests.yml), define separate jobs for the various permutations (especially the "Java" case)
- revert the workaround from https://github.com/aws/aws-toolkit-vscode/pull/1999
Contributor guide
Research direction
Start with src/integrationTest/sam.test.ts to understand the test permutations and how the runner currently selects tests. Then inspect buildspec/linuxIntegrationTests.yml and PR 1999's workaround. Done means selected permutations can run in separate CI jobs, especially Java debug tests, without cleanup interference, and the workaround is reverted.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java, typescript
- Domain
- ci-cd, devtools, testing
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100