josdejong / josdejong/mathjs

BrowserStack tests don't run correctly in case of multiple simultanous runs

Open
#2,261 2 comments 0 reactions 0 assignees View on GitHub
bug help wanted
Dominant language
JavaScript
Stars
15.1k
Forks
1.3k
PR merge metrics
No merged PRs in 30d

Description

Since we switched from TravisCI to github actions, the BrowserStack tests often give issues. It looks like when you push two branches at the same time, the tests for the two different branches are mixed up when running. Often, the BrowserStack tests hang and finally time out.

You can see for example that tests are mixed up from the number of tests completed/skipped, which is _much_ too high (should be 6 times the actual number of tests because we're running on 6 different browsers):

```
Finished in 10 mins 26.368 secs / 9 mins 15.34 secs @ 12:22:21 GMT+0200 (Central European Summer Time)

SUMMARY:
√ 159765 tests completed
i 665 tests skipped
× 45 tests failed
```

Maybe we have to configure a unique id or something, I really have no clue.

Anyone able to look into this?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.