apache / apache/maven-surefire

[SUREFIRE-1287] Improve logging to understand why test run failed and report the right failed category

Open
#2,399 29 comments 0 reactions 0 assignees View on GitHub
bug priority:major
Dominant language
Java
Stars
461
Forks
588
Avg merge
1d 8h
Merged PRs (30d)
19

Description

**[Samarth Jain](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=samarthjain)** opened **[SUREFIRE-1287](https://issues.apache.org/jira/browse/SUREFIRE-1287?redirect=false)** and commented

As part of our automated jenkins builds that run after every checkin, we have been seeing a lot of these failures:

Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.19.1:verify (ParallelStatsEnabledTest) on project phoenix-core: There was a timeout or other error in the fork

Sample run:
https://builds.apache.org/job/Phoenix-master/1420/console

Unfortunately that bit of error information doesn't really help. It would be good to know why exactly the fork timed out or failed. What we do know is that some of the tests in the Junit category ParallelStatsDisabledTest failed to complete. However, failsafe incorrectly reports the failed category as the first category that ran. In this case it happened to be ParallelStatsEnabledTest. Also to note is the fact that failsafe kicks off next category run even before all the tests in the current category have finished. I am not sure if that is by design or a bug.

FYI, [James R. Taylor](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=jamestaylor).

---

**Affects:** 2.19.1

0 votes, 7 watchers

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked Jenkins console run and the reported Failsafe 2.19.1 failure, then trace how Failsafe handles the ParallelStatsEnabledTest and ParallelStatsDisabledTest category runs. Done means the failure output explains why the fork timed out or failed and identifies the category that actually failed.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
build-system, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.