exercism / exercism/groovy-test-runner

Upgrade to version 2 spec

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
x:action/improve x:knowledge/advanced x:module/test-runner x:size/large x:type/coding
Dominant language
Shell
Stars
0
Forks
8
PR merge metrics
No merged PRs in 30d

Description

If possible, this test runner should be updated to version 2 of the [test runner interface specification](https://github.com/exercism/docs/blob/main/building/tooling/test-runners/interface.md).

The version 2 spec differs from version 1 in that the `results.json` file contains detailed information on individual tests.
This information includes things like:

- The test status (passing/failing)
- The error message (if failing)
- The test code that was used to run the test

You are completely free on how you want to extract the test code, either via the AST or via finding the test code in the source code text via string manipulation.

Let me know if there are any questions.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the linked version 2 test runner interface specification and inspecting how this runner currently produces results.json. Done means that results.json includes each test's status, any failure message, and the test code used to run it, as required by the specification.

Written by the indexing model from the issue text.

Assessment

Tech stack
shell
Domain
testing, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.