aws / aws/aws-toolkit-vscode

test/integ: parameterize, parallelize integ tests

Open
#2,001 0 comments 0 reactions 0 assignees View on GitHub
tests-ci-cd
Dominant language
TypeScript
Stars
2k
Forks
807
Avg merge
10h 12m
Merged PRs (30d)
7

Description

## Problem:

integ tests are slow. and some of them (Java debug) are hard to cleanup, or interfere with each other.

## Solution

- add a parameter to the test runner that selects specific integ tests (including permutations of the test in `src/integrationTest/sam.test.ts`
- in our CI [buildspec](https://github.com/aws/aws-toolkit-vscode/blob/master/buildspec/linuxIntegrationTests.yml), define separate jobs for the various permutations (especially the "Java" case)
- revert the workaround from https://github.com/aws/aws-toolkit-vscode/pull/1999

Contributor guide

Open the contributing guide

Research direction

Start with src/integrationTest/sam.test.ts to understand the test permutations and how the runner currently selects tests. Then inspect buildspec/linuxIntegrationTests.yml and PR 1999's workaround. Done means selected permutations can run in separate CI jobs, especially Java debug tests, without cleanup interference, and the workaround is reverted.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, java, typescript
Domain
ci-cd, devtools, testing
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.