apache / apache/maven-surefire

[SUREFIRE-2111] Nested Tests reports are unordered

Open
#2,855 3 comments 0 reactions 0 assignees View on GitHub
bug priority:major
Dominant language
Java
Stars
461
Forks
588
Avg merge
1d 8h
Merged PRs (30d)
19

Description

**[Fabrício Yamamoto](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=JIRAUSER291743)** opened **[SUREFIRE-2111](https://issues.apache.org/jira/browse/SUREFIRE-2111?redirect=false)** and commented

When Nested class are run, it's printed unordered.

See logs:

```java
[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running NestedExampleTest
[INFO] Running NestedExampleTest$InnerTest
[INFO] Running NestedExampleTest$InnerTest$InnerInnerTest
[INFO] Running NestedExampleTest$InnerTest$InnerInnerTest$InnerInnerInnerTest
[INFO] Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.405 s - in NestedExampleTest$InnerTest$InnerInnerTest$InnerInnerInnerTest
[INFO] NestedExampleTest.test  Time elapsed: 0.12 s
[INFO] NestedExampleTest.test2  Time elapsed: 0.001 s
[INFO] NestedExampleTest$InnerTest.test  Time elapsed: 0.202 s
[INFO] NestedExampleTest$InnerTest$InnerInnerTest.test  Time elapsed: 0.305 s
[INFO] NestedExampleTest$InnerTest$InnerInnerTest$InnerInnerInnerTest.test  Time elapsed: 0.402 s
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.717 s - in NestedExampleTest$InnerTest$InnerInnerTest
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.923 s - in NestedExampleTest$InnerTest
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.064 s - in NestedExampleTest
```

It uses 1 event to run all tests, and 3 remaining events to print class timing.

Is it possible to run each nest test in a separate event?

---
No further details from [SUREFIRE-2111](https://issues.apache.org/jira/browse/SUREFIRE-2111?redirect=false)

Contributor guide

Open the contributing guide

Research direction

No source file or test is named in the issue. Start by reproducing the nested-test log and tracing how Surefire receives and prints events for the outer and inner classes. Done means nested tests produce separate events with ordered class timing output, supported by a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
build-system, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.