jackfirth / jackfirth/resyntax

Meta-tests for resyntax/test failure reporting

Open
#821 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

testing
Dominant language
Racket
Stars
70
Forks
11
PR merge metrics
No merged PRs in 30d

Description

test/private/rackunit.rkt is at 76.8% coverage (69 missed lines), and the misses are exactly the code that runs when a refactoring test fails: the code-block pretty-printing writer and the failure message rendering. The raise-syntax-error paths in test.rkt for unbound or non-statement identifiers are similarly untested. Covering these means meta-tests: deliberately-failing checks run via rackunit's run-test-case with assertions on the failure output.

This is worth more than the coverage points. Reviewers lean on this failure output when reviewing AI-written rule PRs, and right now it's the least-tested part of the test framework itself.

Part of #680.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with test/private/rackunit.rkt and inspect the code handling code-block pretty-printing and failure message rendering. Then review the raise-syntax-error paths in test.rkt and run the relevant checks through rackunit's run-test-case. Done means deliberately failing meta-tests assert the expected failure output and cover the unbound and non-statement identifier paths.

Written by the indexing model from the issue text.

Assessment

Domain
testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
75/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.