owncloud / owncloud/ocis

report on added autotests

Open
#9,730 4 comments 0 reactions 0 assignees View on GitHub
QA:team
Dominant language
Go
Stars
2.1k
Forks
274
Avg merge
2d 1h
Merged PRs (30d)
103

Description

### Task:
We need to implement the creation of a QA activity report (automated testing context) that will include information which tests we have added/deleted/changed in a certain time (should be configurable)

It should only contain information about the change to the `.feature` file. We do not need to provide stepImplementation info

### we need include info to the report:
common info:
```
- Added lines to the .feature files: 391
- Deleted lines in the .feature files: 191
- Modified lines in the .feature files: 582
```

specific information:
```
- added/deleted/changed scenario - name and counts
- number of added/deleted/changed steps - only counts
- if we have a table of examples -> case numbers in one scenario
- commitId
- author
- date

```

first we need provide report for web(e2e) and ocis(acceptance) tests.

I guess we need get git log first and parse log to a readable report:
web: `git log --since='20 days ago' -p -- tests/e2e/cucumber/features`
ocis: `git log --since='20 days ago' -p -- tests/acceptance/features/ | grep -v 'tests/acceptance/features/bootstrap/'`

for web (need improve): https://github.com/owncloud/web/pull/11323

dummy report:

# QA Activity Report for August 2024
Date: 05.08.2024

## Summary
Added lines to the .feature files: 391
Deleted lines in the .feature files: 191
Modified lines in the .feature files: 582

## Detailed Changes
### Commit: 9090ac3bac040cdd1a6d970f3fda4b342e936cc7
Author: Viktor Scharf
Date: Thu Aug 1 16:05:14 2024 +0200

#### Added Scenarios:
Scenario Name: User logs in with valid credentials
Steps Added: 5
Examples Added: 2

#### Deleted Scenarios:
Scenario Name: User tries to log in with invalid credentials
Steps Deleted: 4

#### Changed Scenarios:
Scenario Name: User changes password successfully
Steps Modified: 3
Examples Modified: 1

------------

### Commit: e23ebf776f5fe2250e8462e1846df0f75ccfdcbe
Author: Sawjan Gurung
Date: Tue Aug 2 10:05:14 2024 +0200

#### Added Scenarios:
Scenario Name: Admin creates a new user
Steps Added: 6
Examples Added: 3

####Deleted Scenarios:
Scenario Name: User views their profile
Steps Deleted: 3

#### Changed Scenarios:
Scenario Name: User updates profile information
Steps Modified: 4
Examples Modified: 2

------------

### Commit: i7j8k9l

image

or report with more details like:
[QA_Activity_report.md](https://github.com/user-attachments/files/16497137/QA_Activity_report.md)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.