[SUREFIRE-1896] Cucumber JUnit5 scenarios are executed but not counted in results

**[Kevin Werner](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=softwerkbank)** opened **[SUREFIRE-1896](https://issues.apache.org/jira/browse/SUREFIRE-1896?redirect=false)** and commented

I'm trying to execute Cucumber scenarios with Maven. If I use the surefire plugin version 2.22.2 everything is fine. But when I change to 3.0.0-M5 the scenarios were executed but not counted in the results. There are two error logs concerning junit-platform.properties.

Because of that the build will succeed, even if there are test failures in cucumber scenarios.

Screenshots and pom.xml is attached.

---

**Affects:** 3.0.0-M5

**Attachments:**
- [cucumber_surefire_2.22.2.png](https://issues.apache.org/jira/secure/attachment/13022663/cucumber_surefire_2.22.2.png) (_19.49 kB_)
- [cucumber_surefire_3.0.0-M5.png](https://issues.apache.org/jira/secure/attachment/13022662/cucumber_surefire_3.0.0-M5.png) (_23.37 kB_)
- [pom.xml](https://issues.apache.org/jira/secure/attachment/13022661/pom.xml) (_1.86 kB_)

2 votes, 5 watchers

Start with the attached pom.xml and compare the 2.22.2 and 3.0.0-M5 screenshots and error logs for the Cucumber JUnit5 setup. Reproduce the scenario-counting problem with Surefire 3.0.0-M5; done means failed Cucumber scenarios are included in the results and make the Maven build fail.

Written by the indexing model from the issue text.