aws / aws/aws-toolkit-vscode

unreliable test: "review insecure file or project"

Open
#6,922 1 comment 0 reactions 0 assignees View on GitHub
tests-ci-cd
Dominant language
TypeScript
Stars
2k
Forks
807
Avg merge
10h 12m
Merged PRs (30d)
7

Description

## Test Details

- Name of test:
- OS of failure:
- VSCode version of failure (minimum/insider/stable):
- Link to failing run:
- Link to failing test:

## Log of Test Failure

```
1) Amazon Q Code Review
/review entry
review insecure file or project
/review file gives correct critical and high security issues:

AssertionError [ERR_ASSERTION]: Expected values to be loosely deep-equal:

0

should loosely deep-equal

1
+ expected - actual

-0
+1

at hasExactlyMatchingSecurityDiagnostic (test/e2e/amazonq/review.test.ts:78:16)
at Context. (test/e2e/amazonq/review.test.ts:212:17)
```

## Additional Information

Contributor guide

Open the contributing guide

Research direction

Start with test/e2e/amazonq/review.test.ts, especially hasExactlyMatchingSecurityDiagnostic at line 78 and the failing case around line 212. Run the end-to-end test to determine why the insecure file or project review returns zero diagnostics instead of one; done means the test reliably observes the expected critical and high security issues.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
testing-qa
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.