ember-cli / ember-cli/ember-exam

Incorrect labels for tests when running in parallel mode

Open
#123 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
JavaScript
Stars
289
Forks
65
Avg merge
4m
Merged PRs (30d)
9

Description

I am seeing incorrect labels on my tests when I run them in parallel mode with randomization on. I run my tests using this command:

`ember exam --random=$CIRCLE_SHA1 --split=4 --partition=n`

...where `n` is the partition I want to run in a given CircleCI 2.0 container. Note that `$CIRCLE_SHA1` is the git sha for the commit - seemed like a reasonable choice for a randomization seed.

In any event, the effect I am seeing is that the log output that appears in CircleCI doesn't match the actual tests I'm running. Whereas the CircleCI output looks something like this:

`not ok 139 Chrome 60.0 - Exam Partition 1 - JSHint | components/cool-component/component.js: it should do the thing right`

...the actual test that matches the string `should do the thing right` lives under something like:

`Acceptance | components/other-thing-entirely/sub-thing/component.js`

Can you think of a reason this might be happening? Naturally it makes it a bit difficult to interpret what CircleCI is telling me, as the failing test, from what I can tell, is not a JSHint error, but the misdirection makes me less confident that I can find the right test by the label.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.