argotorg / argotorg/fe

Add a CI check that fails if we are missing a test for a user error

Open
#765 2 comments 0 reactions 0 assignees View on GitHub
type: ci
Dominant language
Rust
Stars
1.7k
Forks
218
Avg merge
1d 7h
Merged PRs (30d)
6

Description

### What is wrong?

Some of the errors that the compiler is supposed to present to the user aren't covered by tests.

### How can it be fixed

Add a CI check that:

1. extracts a unique part of each user facing error message that the compiler produces
2. Check that the unique part is somewhere present in our snapshots

That should ensure we do not end up in a situation where we have uncovered compiler errors.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating where the compiler's user-facing errors are defined or emitted, where their snapshots are stored, and how CI checks are configured. Determine how to extract a unique message part and compare it with the snapshots; done means CI fails when an error has no matching snapshot and passes for covered errors.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
ci-cd, compilers, testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.