allure-framework / allure-framework/allure-python

[Robot Framework Browser/Playwright] - The usage of parentSuite and suite metadata add the test 4 times in the report

Open
#819 1 comment 0 reactions 0 assignees View on GitHub
bug theme:robotframework
Dominant language
Python
Stars
814
Forks
260
PR merge metrics
No merged PRs in 30d

Description

[//]: # (
. Note: for support questions, please use Stackoverflow or Gitter**.
. This repository's issues are reserved for feature requests and bug reports.
.
. In case of any problems with Allure Jenkins plugin** please use the following repository
. to create an issue: https://github.com/jenkinsci/allure-plugin/issues
.
. Make sure you have a clear name for your issue. The name should start with a capital
. letter and no dot is required in the end of the sentence. An example of good issue names:
.
. - The report is broken in IE11
. - Add an ability to disable default plugins
. - Support emoji in test descriptions
)

#### I'm submitting a ...
- [X] bug report
- [ ] feature request
- [ ] support request => Please do not submit support request here, see note at the top of this template.

#### What is the current behavior?
Each test is added 4 times in the report when using these tags :
```
allure.label.parentSuite:xxxxx
allure.label.suite:xxxxx
```
![image](https://github.com/allure-framework/allure-python/assets/16239820/be4bd59b-b8dc-48a6-b48c-164161fe3a5d)

#### If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal demo of the problem
The feature file :

```
*** Settings ***
Documentation Testing the fill-in and submit of a web form.

Resource ../keywords/webform.robot
Library AllureLibrary

*** Test Cases ***
test_fill_in_form
[TAGS]
... allure.label.epic:Web interface (Robot Framework)
... allure.label.parentSuite:Web interface (Robot Framework)
... allure.label.suite:Web Form
... allure.label.story:Web Form
... allure.label.package:web_robotframework.webform_test
... allure.label.testMethod:test_fill_in_form

```

The tree of my python code source is as follows :
```
web_robotframework_playwright
|- keywords
|- webform.robot
|- tests
|- webform_page.robot
```
![image](https://github.com/allure-framework/allure-python/assets/16239820/d9a3eb91-c02c-4404-923f-1a34b97eeedb)

#### What is the expected behavior?
The test is added once
The suite view displays the metadata set in the test tags (parentSuite, suite and subsuite)

#### What is the motivation / use case for changing the behavior?
A test should by added to the report once instead of being added 4 times.

#### Please tell us about your environment:

- Allure version: 2.29.0
- Test framework: robotframework-browser@18.5.1
- Allure adaptor: allure-robotframework@2.13.5

#### Other information

[//]: # (
. e.g. detailed explanation, stacktraces, related issues, suggestions
. how to fix, links for us to have more context, eg. Stackoverflow, Gitter etc
)

Contributor guide

Open the contributing guide

Research direction

Start with tests/webform_page.robot and keywords/webform.robot, then reproduce the report using the shown parentSuite and suite tags with robotframework-browser 18.5.1 and allure-robotframework 2.13.5. Done means the report contains the test once and the suite view displays the parentSuite, suite, and subsuite metadata.

Written by the indexing model from the issue text.

Assessment

Tech stack
playwright, python
Domain
testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.