Replacing chromy with puppeteer (originally: Failing with no images in report, and no screenshot for test taken)
- Dominant language
- JavaScript
- Stars
- 7.2k
- Forks
- 621
- PR merge metrics
- No merged PRs in 30d
Description
I'm having some issues with randomly getting failed tests where the error report does not show any images;
Console log:

Error report:

Chrome Dev tools inspection of error report:

Error report, show diffs clicked (broken image link):

Chrome Dev tools inspection of show diffs error report (notice img src attrs):

The failed compare ("Home-Welcome 02 Toolbar (tablet-landscape)", according to console log) does have a reference image but in the test folder no image for this test exists.
I had the issue when asyncCaptureLimit was set to 5, I have experimented with lowering it but still these kind of fails keeps happening randomly.
It seems more likely to happen when I'm running the batch of all my scenarios over running only a few. But I just now had a case when I filtered out 3 scenarios and set the asyncCaptureLimit to 1 and not a single screenshot was taken, so not even a folder was created in the bitmaps_test folder. This happens repeatedly right now.
Any suggestions on what I can do? I'm eager to introduce the tool to my colleagues and run backstop within our CI but due to this issue it does not feel stable enough.
Contributor guide
Assessment
This issue has not been assessed yet.