NVIDIA-NeMo / NVIDIA-NeMo/Safe-Synthesizer
Run every test at some frequency in CI
@binaryaaron is already working on this.
Since Apr 23, 2026.
- Dominant language
- Python
- Stars
- 38
- Forks
- 11
- Avg merge
- 4d 17h
- Merged PRs (30d)
- 9
Description
Priority Level
Medium
Task Summary
We have tests, but aren't running them. CI should run every test at some frequency in CI, is there any tooling to check that this is case?
This issue is mostly about the slow unit tests, but also gpu and e2e tests have spotty coverage right now.
#337 merged last week and appears to have broken an evaluation test, but we didn't find out until I randomly ran make test-unit-slow for #430.
Every test should run daily (or at worst weekly). Need to add github workflows to accomplish this for test-unit-slow at least, and possibly others.
Also need a way for us to find out the daily runs fail. Maybe manually checking to start, but hooking up a slack bot or such might be helpful.
Technical Details & Implementation Plan
No response
Dependencies
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.