gotestyourself / gotestyourself/gotestsum

`--rerun-fails` always makes goleak and datarace errors pass after re-running

Open
#442 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
2.7k
Forks
171
PR merge metrics
No merged PRs in 30d

Description

## Description

When using `--rerun-fails=1` option with `gotestsum`, all of the tests pass. The behavior is very deterministic. Instead when removing the option, I am getting a lot of `goleak` and `data-race` errors. It's quite interesting that the behavior with re-running the tests is very deterministic, as I would expect from a big number of tests and multiple runs, it should fail at least once also in the re-run. It seems to me that in the 2. run, the `gotestsum` just ignores the errors which popped up during the first run

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported behavior with gotestsum's --rerun-fails=1 option, comparing runs with and without it. Trace how goleak and data-race errors are recorded across the initial and rerun results. Done means reruns preserve and report those errors instead of making all tests pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
cli, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.