citrusframework / citrusframework/citrus-admin

DISABLED tests (XML definition) show as successful in UI

Open
#50 0 comments 0 reactions 0 assignees View on GitHub
Prio: Medium READY Type: Bug
Dominant language
Java
Stars
17
Forks
11
PR merge metrics
No merged PRs in 30d

Description

### Problem

In my test suite (`Citrus 2.7.1`, XML tests), I have disabled some tests via

```xml
DISABLED
```

As expected, they are skipped by Citrus (not by TestNG or JUnit!):

```
17:27:15,038 INFO citrus.Citrus| CITRUS TEST RESULTS
17:27:15,038 INFO citrus.Citrus|
17:27:15,039 INFO citrus.Citrus| IT_001_xxxxxxxxxxxxxxxxxxxxxxxxxxxx ............................ SKIPPED
17:27:15,039 INFO citrus.Citrus| IT_002_xxxxxxxxxxxxxxxxxx ...................................... SKIPPED
17:27:15,039 INFO citrus.Citrus| IT_003_xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx ..................... SKIPPED
17:27:15,039 INFO citrus.Citrus| IT_004_xxxxxxxxxxxxxxxxx ....................................... SUCCESS
17:27:15,039 INFO citrus.Citrus| IT_005_xxxxxxxxxxxxxx .......................................... SKIPPED
17:27:15,039 INFO citrus.Citrus| IT_006_xxxxxxxxxxxxxxxxxxxxxxxx ................................ SKIPPED
17:27:15,039 INFO citrus.Citrus| IT_007_xxxxxxxxxxxxxx .......................................... SUCCESS
17:27:15,039 INFO citrus.Citrus| IT_009_xxxxxxxxxxxxxxxxxx ...................................... SUCCESS
17:27:15,039 INFO citrus.Citrus| IT_010_xxxxxxxxxxxxxxxxxxxxxxxxxxx ............................. SUCCESS
17:27:15,039 INFO citrus.Citrus|
```

However, the Citrus Admin UI show the tests as successfully executed. It obviously only parses the TestNG/JUnit results.

![tests_censored](https://user-images.githubusercontent.com/8246851/28114130-c23e1c16-66ff-11e7-9ce9-3f27c7f770f8.png)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.