exercism / exercism/reasonml-test-runner

Upgrade to version 2 spec

Open
#9 0 comments 0 reactions 0 assignees View on GitHub
x:action/improve x:knowledge/advanced x:module/test-runner x:size/large x:type/coding
Dominant language
Shell
Stars
0
Forks
9
Avg merge
7d 3h
Merged PRs (30d)
1

Description

If possible, this test runner should be updated to version 2 of the [test runner interface specification](https://github.com/exercism/docs/blob/main/building/tooling/test-runners/interface.md).

The version 2 spec differs from version 1 in that the `results.json` file contains detailed information on individual tests.
This information includes things like:

- The test status (passing/failing)
- The error message (if failing)
- The test code that was used to run the test

You are completely free on how you want to extract the test code, either via the AST or via finding the test code in the source code text via string manipulation.

Let me know if there are any questions.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the linked test runner interface specification, focusing on the version 2 requirements for results.json. Then inspect the runner's existing version 1 result generation and determine how individual test status, errors, and test code are represented. Done means the runner emits version 2-compatible detailed results.json output.

Written by the indexing model from the issue text.

Assessment

Tech stack
shell
Domain
testing-qa, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.