gotestyourself / gotestyourself/gotestsum

`--rerun-fails` and `--junitfile`: tests marked as failed even though they were rerun with success

Open
#281 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
2.7k
Forks
171
PR merge metrics
No merged PRs in 30d

Description

Example: there are 178 tests in the test suite. We run them with the --rerun option, and when a test fails then the reporter adds it as failed in the jUnit report. But if succeeded during a re-run, then it's not marked as passed again.

Action URL: https://github.com/testcontainers/testcontainers-go/actions/runs/3198462957
Screenshot in case the build is discarded:
Screenshot 2022-10-06 at 17 51 37

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported behavior with --rerun and --junitfile, using the linked GitHub Actions run as a reference. Inspect the generated JUnit report for a test that first fails and then succeeds; done means successfully rerun tests are reported as passed rather than failed.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.