apache / apache/maven-surefire

[SUREFIRE-1145] Surfire test listener disregards final counter adjustments

Open
#2,542 2 comments 0 reactions 0 assignees View on GitHub
bug priority:minor
Dominant language
Java
Stars
461
Forks
588
Avg merge
1d 8h
Merged PRs (30d)
19

Description

**[Valentin Mayamsin](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=yavalek)** opened **[SUREFIRE-1145](https://issues.apache.org/jira/browse/SUREFIRE-1145?redirect=false)** and commented

I have testng tests with retry analizer the way it's described here:

http://seleniumeasy.com/testng-tutorials/execute-only-failed-test-cases-using-iretryanalyzer

I also have a test listener which adjusts final test results respecting retrials the way it's described here:

http://stackoverflow.com/a/18374673/331212

Maven surfire plugin fails anyway since it has its own test listener which maintains its own counters and disregards final results.

---

**Affects:** 2.18.1

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the TestNG retry-analyzer and test-listener scenario described in the issue and its linked examples. Then trace Surefire's listener counters and compare them with the final adjusted results; done means the plugin respects those final results instead of failing from its own counters.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
build-system, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.