gotestyourself / gotestyourself/gotestsum

Intermediate failures that are re-run and eventually pass are showed in the failure summary, which can be confusing

Open
#423 8 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
Go
Stars
2.7k
Forks
171
PR merge metrics
No merged PRs in 30d

Description

Version: from main

Unfortunately this is happening on a private repository, so I can't share a minimal example. If you do require one and the issue isn't obvious, I can work to make one.

Here's the command:

```
gotestsum --junitfile reports/go-test-report.xml --rerun-fails --packages './...' -- -race -short
```

I've noticed that if I add `--hide-summary output` this problem doesn't happen. It might be something to do with how the test results are being outputted (potentially a race condition between different processes there?)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported command with --rerun-fails, --junitfile, --packages './...', and the Go test flags -race -short. Compare the failure summary with and without --hide-summary output; done means intermediate failures that later pass no longer appear as final failures, while the JUnit report remains correct.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
cli, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.