garris / garris/BackstopJS

Tests seem to pass only when running one at a time

Open
#1,339 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
7.2k
Forks
621
PR merge metrics
No merged PRs in 30d

Description

We are running tests 5 at a time using `asyncCaptureLimit: 5`. This is causing tests to fail and fail almost randomly (not the same tests failing every time). The tests show that there are like 5-10 pixels off on the pages. However, with seeing this in the browser and just running the tests, nothing has clearly changed. However, when running the tests 1 by 1 manually, the tests pass. Seems like more of the tests pass when I set asyncCaptureLimit to 2. Any idea why this is happening? It is very inconsistent and honestly a real headache for our dev team to the point where we assume the regression tests will always fail because on the inconsistency and reliability of our tests.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.