exercism / exercism/configlet

ci: diff output from `lint` and `sync` with previous configlet release

Open
#556 0 comments 1 reaction 0 assignees View on GitHub
kind: ci
Dominant language
Nim
Stars
23
Forks
17
Avg merge
13h 57m
Merged PRs (30d)
1

Description

Follow-up from https://github.com/exercism/configlet/issues/523#issuecomment-1099162786

I have a script for this, which I've run for all the configlet releases. But it probably needs some tidying up before it works in this repo.

---

Edit 2023-10-02:
I think we can consider this part of the integration tests, but a separate job that's allowed to fail (where it indicates failure if the PR causes any configlet command to produce different output on any track).

And maybe for PRs only (not on push).

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the existing script used to compare configlet releases and the repository's integration-test and CI configuration. Run the comparison across prior releases, then verify that the proposed PR-only, allowed-to-fail job reports when lint or sync output differs; completion means the comparison works reliably in this repository.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, nim
Domain
ci-cd, testing, tooling
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.