authorjapps / authorjapps/zerocode

Maven single test build failure marked as success

Open
#529 0 comments 0 reactions 0 assignees View on GitHub
help wanted not-an-issue question
Dominant language
Java
Stars
1k
Forks
453
Avg merge
7d 2h
Merged PRs (30d)
5

Description

Hello,

when running single test using maven:

mvn -B -f /app/jenkins/workspace/SingleIntegrationTest/tests/pom.xml clean compile **-Dtest=SingleTest#testMethod** test -Dio.netty.tmpdir=/var/tmp -Djava.io.tmpdir=/var/tmp -pl integration-tests -am -Dsurefire.failIfNoSpecifiedTests=false

I'm getting assertion errors:
15:16:01.285 [main] ERROR o.j.z.c.r.StepNotificationHandler - Assertion failed for :-

[Single step with assertions]
|
|
+---Step --> [failing_step]

Failures:
---------
Assertion jsonPath '$.body[1].name' with actual value 'A' did not match the expected value 'B'
----------------------------------------------------------------------------------------------------------------------------------
Assertion jsonPath '$.body[3].id' with actual value '123' did not match the expected value '456'
----------------------------------------------------------------------------------------------------------------------------------
Assertion jsonPath '$.body[2].type' with actual value 'Water' did not match the expected value 'Sand'
----------------------------------------------------------------------------------------------------------------------------------
(See below 'Actual Vs Expected' to learn why this step failed)

But still build if marked as success and no tests are marked as executed:

[INFO]
[INFO] Results:
[INFO]
[INFO] Tests run: 0, Failures: 0, Errors: 0, Skipped: 0
...
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:14 min
[INFO] Finished at: 2022-06-13T15:16:08+02:00
[INFO] ------------------------------------------------------------------------

Test class defined with:

@SpringBootTest
@TargetEnv("application.properties")
@RunWith(ZeroCodeUnitRunner.class)

and method with:

@Test
@Scenario("tests/SingleTest/failingTest.yml")

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.