rtfeldman / rtfeldman/node-test-runner

Add information about skipped tests in junit report

Open
#427 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
JavaScript
Stars
140
Forks
83
Avg merge
8h 25m
Merged PRs (30d)
5

Description

If I run a test suite with with some tests skipped via simple elm-test, the result is failure as described in readme. However, if I want to generate an xml/html report via elm-test --report junit I have no information that there were skipped tests at all. In the meantime, elm-test --report json has an entry "autoFail":"Test.skip was used".

I wonder if it is possible to add info on skipped test to the junit report as well? At least a mention of that fact, or better well with test names/paths. If I understand correctly, junit specs allow for ignored/disabled tests in its reports.

My config:

$ elm-test --version
0.19.1-revision2
$ elm --version
0.19.1

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by comparing the existing elm-test --report json output, which includes autoFail, with the elm-test --report junit output for suites containing skipped tests. Trace the report entry points and JUnit generation until you can represent skipped tests, then verify that the XML includes at least a skipped-test indication and preferably names or paths.

Written by the indexing model from the issue text.

Assessment

Tech stack
elm, javascript
Domain
testing-qa
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.