software-mansion / software-mansion/react-native-executorch
Add approval testing for native modules
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 1.7k
- Forks
- 96
- Avg merge
- 20h 51m
- Merged PRs (30d)
- 59
Description
Currently, native module integration tests only verify that models execute without crashing and produce output. However, they don't validate that the output is correct. For example, image generation models return image data, but we don't verify the images are visually correct or match expected results.
The scope of this task is to introduce approval/snapshot testing for model outputs. Tests will compare model outputs against known-good reference files to detect regressions in model exports.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the native module integration tests and review ApprovalTests.cpp for the approval/snapshot testing approach. Define reference files for model outputs, including image generation results, and verify that the tests detect regressions in model exports.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning, testing-qa
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100