aws-amplify / aws-amplify/amplify-hosting
Console Test Grayed Out Even When The Test Passed
- Dominant language
- Dockerfile
- Stars
- 481
- Forks
- 123
- PR merge metrics
- No merged PRs in 30d
Description
### Before opening, please confirm:
- [X] I have checked to see if my question is addressed in the [FAQ](https://github.com/aws-amplify/amplify-hosting/blob/master/FAQ.md).
- [X] I have [searched for duplicate or closed issues](https://github.com/aws-amplify/amplify-hosting/issues?q=is%3Aissue+).
- [X] I have read the guide for [submitting bug reports](https://github.com/aws-amplify/amplify-hosting/blob/master/CONTRIBUTING.md).
- [X] I have done my best to include a minimal, self-contained set of instructions for consistently reproducing the issue.
- [X] I have removed any sensitive information from my code snippets and submission.
### App Id
d2iylcvof45zeg
### AWS Region
us-east-2
### Amplify Hosting feature
E2E Cypress tests
### Describe the bug
As shown on the following screenshot, the tests passed, but the "Test" icon on top was grayed out.

### Expected behavior
"Test" Icon should turn into the green check when all tests passed.
### Reproduction steps
1. add a Cypress test and configure to use Amplify hosting build process
2. add a `cy.reuquest` without `expect`
3. see the test passed, but it's both "passing" and "failing"

### Build Settings
_No response_
### Log output
```
# Put your logs below this line
2022-10-20T21:19:40.403Z [INFO]: Links
2022-10-20T21:19:40.497Z [INFO]: ✓ work if they are on the Sitemap
2022-10-20T21:19:40.518Z [INFO]:
2022-10-20T21:19:40.524Z [INFO]: 1 passing (181ms)
2022-10-20T21:19:40.539Z [INFO]: [mochawesome] Report JSON saved to /codebuild/output/src096548617/src/amplify-ui/docs/cypress/report/mochawesome-report/mochawesome_10202022_211940.json
2022-10-20T21:19:44.179Z [INFO]: event - build page: /[platform]
2022-10-20T21:19:44.257Z [INFO]: wait - compiling...
2022-10-20T21:19:48.321Z [INFO]: (Results)
2022-10-20T21:19:48.330Z [INFO]: ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Tests: 1 │
│ Passing: 1 │
│ Failing: 0 │
│ Pending: 0 │
│ Skipped: 0 │
│ Screenshots: 0 │
│ Video: true │
│ Duration: 0 seconds │
│ Spec Ran: links.cy.ts │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
2022-10-20T21:19:48.447Z [INFO]:
2022-10-20T21:19:48.447Z [INFO]: (Video)
2022-10-20T21:19:48.448Z [INFO]: - Started processing: Compressing to 32 CRF
2022-10-20T21:19:49.585Z [INFO]: event - compiled successfully
2022-10-20T21:19:50.171Z [INFO]: - Finished processing: /codebuild/output/src096548617/src/amplify-ui/docs/cypress/ (1 second)
videos/links.cy.ts.mp4
2022-10-20T21:19:50.171Z [INFO]:
2022-10-20T21:19:50.187Z [INFO]:
2022-10-20T21:19:50.207Z [WARNING]: tput: No value for $TERM and no -T specified
2022-10-20T21:19:50.207Z [INFO]: ================================================================================
(Run Finished)
2022-10-20T21:19:50.209Z [INFO]:
2022-10-20T21:19:50.211Z [INFO]: Spec Tests Passing Failing Pending Skipped
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ ✔ links.cy.ts 167ms 1 1 - - - │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
✔ All specs passed! 167ms 1 1 - - -
2022-10-20T21:19:50.398Z [INFO]: # Completed phase: test
# Starting phase: postTest
```
### Additional information
_No response_
Contributor guide
Research direction
Start by reproducing the issue with the Cypress test described in the report and review the links.cy.ts output alongside the supplied Amplify Hosting build log. Trace how the hosted Cypress results are interpreted for the console Test icon; done means a run with all tests passing produces the green check rather than a mixed passing/failing state.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, cypress, typescript
- Domain
- ci-cd, cloud, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100