kowainik / kowainik/stan

Improve testing framework

Open
#362 0 comments 2 reactions 0 assignees View on GitHub
tests
Dominant language
Haskell
Stars
597
Forks
53
PR merge metrics
No merged PRs in 30d

Description

A few improvements to our tests to make them more robust and maintainable:

- [ ] Put each inspection test into a separate module
- [ ] Put a JSON golden file with expected inspections for this file
- [ ] Implement testing to compare inspections from files with golden output
- [ ] Implement golden-generator tool to create/update golden tests automatically

The only challenging part of this plan is to come up with some solution for filtering irrelevant inspections for each module, so we have only relevant test-cases.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing inspection tests and how inspections are currently collected; the issue names no files or entry points. Done means separating inspection tests into modules, adding JSON golden files and comparison, providing a golden-generator tool, and defining how irrelevant inspections are filtered.

Written by the indexing model from the issue text.

Assessment

Tech stack
haskell
Domain
testing-qa, tooling
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.