Make integration tests to check for individual model variations
Open
Nobody has claimed this yet.
Testing
- Dominant language
- Python
- Stars
- 71
- Forks
- 27
- Avg merge
- 2d 18h
- Merged PRs (30d)
- 33
Description
Description of issue / requirement to address
For individual model changes we dont currently track the effect of all changes just ones that happen to be covered by the regression tests
Proposed solution
Create integration tests that feed into the tracker that run process in evaluation mode each test should cover the model being updated
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the existing regression and integration tests, the evaluation-mode entry point, and the tracker mentioned in the issue. Done means each individual model variation is covered by an integration test and its evaluation result is recorded by the tracker.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100