UMass-Rescue / UMass-Rescue/RescueBox
RescueBox: plugin accuracy dataset compliance tests
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6
- Forks
- 15
- Avg merge
- 14h 42m
- Merged PRs (30d)
- 7
Description
Scenario: a customer sends an image thru an existing rescuebox plugin and the output is unexpected or wrong. for example : age-detector plugin outputs incorrect age
we need to test better.
can we come up with sample images that are borderline or edge case that expose plugin limits or bugs ?
a dataset that can be used for all image plugins would be nice. a new plugin would have to "Pass" using such a dataset.
failures can be either limitations or bugs to be fixed.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the existing RescueBox image plugins and how their outputs are tested; the issue does not name files or test entry points. Review the linked teen-image dataset and define a shared edge-case dataset, plugin pass criteria, and how limitations versus bugs should be recorded.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- computer-vision, testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100