aws-amplify / aws-amplify/amplify-hosting

Console Test Grayed Out Even When The Test Passed

Open
#3,044 2 comments 0 reactions 0 assignees View on GitHub
bug console
Dominant language
Dockerfile
Stars
481
Forks
123
PR merge metrics
No merged PRs in 30d

Description

### Before opening, please confirm:

- [X] I have checked to see if my question is addressed in the [FAQ](https://github.com/aws-amplify/amplify-hosting/blob/master/FAQ.md).
- [X] I have [searched for duplicate or closed issues](https://github.com/aws-amplify/amplify-hosting/issues?q=is%3Aissue+).
- [X] I have read the guide for [submitting bug reports](https://github.com/aws-amplify/amplify-hosting/blob/master/CONTRIBUTING.md).
- [X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
- [X] I have removed any sensitive information from my code snippets and submission.

### App Id

d2iylcvof45zeg

### AWS Region

us-east-2

### Amplify Hosting feature

E2E Cypress tests

### Describe the bug

As shown on the following screenshot, the tests passed, but the "Test" icon on top was grayed out.

![Pasted_Image_10_20_22__14_27](https://user-images.githubusercontent.com/11983489/197062494-9dd2c836-f799-4a38-a733-ecc5a562461c.png)

### Expected behavior

"Test" Icon should turn into the green check when all tests passed.

### Reproduction steps

1. add a Cypress test and configure to use Amplify hosting build process
2. add a `cy.reuquest` without `expect`
3. see the test passed, but it's both "passing" and "failing"

![image](https://user-images.githubusercontent.com/11983489/197063007-c142e98f-de47-4def-acee-2e0bd008e32b.png)

### Build Settings

_No response_

### Log output

```
# Put your logs below this line
2022-10-20T21:19:40.403Z [INFO]: Links
2022-10-20T21:19:40.497Z [INFO]: ✓ work if they are on the Sitemap
2022-10-20T21:19:40.518Z [INFO]:
2022-10-20T21:19:40.524Z [INFO]: 1 passing (181ms)
2022-10-20T21:19:40.539Z [INFO]: [mochawesome] Report JSON saved to /codebuild/output/src096548617/src/amplify-ui/docs/cypress/report/mochawesome-report/mochawesome_10202022_211940.json
2022-10-20T21:19:44.179Z [INFO]: event - build page: /[platform]
2022-10-20T21:19:44.257Z [INFO]: wait - compiling...
2022-10-20T21:19:48.321Z [INFO]: (Results)
2022-10-20T21:19:48.330Z [INFO]: ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Tests: 1 │
│ Passing: 1 │
│ Failing: 0 │
│ Pending: 0 │
│ Skipped: 0 │
│ Screenshots: 0 │
│ Video: true │
│ Duration: 0 seconds │
│ Spec Ran: links.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
2022-10-20T21:19:48.447Z [INFO]:
2022-10-20T21:19:48.447Z [INFO]: (Video)
2022-10-20T21:19:48.448Z [INFO]: - Started processing: Compressing to 32 CRF
2022-10-20T21:19:49.585Z [INFO]: event - compiled successfully
2022-10-20T21:19:50.171Z [INFO]: - Finished processing: /codebuild/output/src096548617/src/amplify-ui/docs/cypress/ (1 second)
videos/links.cy.ts.mp4
2022-10-20T21:19:50.171Z [INFO]:
2022-10-20T21:19:50.187Z [INFO]:
2022-10-20T21:19:50.207Z [WARNING]: tput: No value for $TERM and no -T specified
2022-10-20T21:19:50.207Z [INFO]: ================================================================================
(Run Finished)
2022-10-20T21:19:50.209Z [INFO]:
2022-10-20T21:19:50.211Z [INFO]: Spec Tests Passing Failing Pending Skipped
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ ✔ links.cy.ts 167ms 1 1 - - - │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
✔ All specs passed! 167ms 1 1 - - -
2022-10-20T21:19:50.398Z [INFO]: # Completed phase: test
# Starting phase: postTest

```

### Additional information

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the issue with the Cypress test described in the report and review the links.cy.ts output alongside the supplied Amplify Hosting build log. Trace how the hosted Cypress results are interpreted for the console Test icon; done means a run with all tests passing produces the green check rather than a mixed passing/failing state.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, cypress, typescript
Domain
ci-cd, cloud, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.