exercism / exercism/chapel-test-runner

general overview

Open
#3 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Chapel
Stars
1
Forks
3
Avg merge
27m
Merged PRs (30d)
1

Description

This is the next (and last) big thing to do before getting the track released. Time to get serious with it.

In this issue, I summarize my understanding of the guidelines, to make sure I understand what I have to do and try to sketch a concrete action plan.

Overall, I think this should be easier than it looks, because we should have almost all pieces ready, namely
- we already have a bash script to test exercises
- we have a docker image we use in the CI.

I understand there are three levels of ambition:

- LEVEL 1: A single grade for the whole exercise, pass if everything is fine and fail otherwise
- LEVEL 2: info for individual tests of the exercise.
- LEVEL 3: let's think about this in the future, sometimes you gotta choose your battles

So the main challenge is to implement the logic to generate the JSON.

My rough roadmap:

- [x] implement level 1: this should be fairly straightforward, run `mason test` and use the resulting exit code to choose what to write in the JSON. Could be done as a small bash script
- [x] Make it work in docker.
- [ ] Implement level 2: there are a few approaches. For example, capture the output of `mason test --show` and parse it to get the result of each individual test. This can be done with a quick and dirty script. Alternative add a method to `Test` class that generates the JSON while running the tests, requires some work but probably not too much.

Comments? Suggestions?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.