bizz84 / bizz84/AcceptanceMark

AcceptanceMark Generate Test Reports

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Swift
Stars
64
Forks
8
PR merge metrics
No merged PRs in 30d

Description

## Purpose: See test success/failures via a file report that can be stored as an artifact in CI.

As the AcceptanceMark test suite runs, we want to generate a test report.

One way of doing this is to extend the generated test methods to pipe the results (success/failure with details) into an HTML file with green/red tests similar to the Fitnesse Test Report.

One advantage of this is that if the test suite crashed, all test results up to that point will have been already written into a file. **NOTE how to deal with tests running concurrently? Need to ensure the report file is written atomically and in order**

The generated test methods are the ideal place for this as they have knowledge of the inputs, outputs and expected values for each test.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the generated test methods, since the issue identifies them as the source of test inputs, outputs, expected values, and results. Review how concurrent test execution would affect an HTML report and determine how results can be written atomically and in order. Done means CI can store the report as an artifact and it preserves results up to a test-suite crash.

Written by the indexing model from the issue text.

Assessment

Tech stack
swift
Domain
testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.