aws-samples / aws-samples/aws-batch-comp-infrastructure-sample
`acceptance-test` inconsistent with `test-local`
- Dominant language
- Python
- Stars
- 12
- Forks
- 14
- Avg merge
- 16h 1m
- Merged PRs (30d)
- 3
Description
On the `mainline-2026` branch, I succeeded in locally testing a _parallel_ SMT solver with the `test-local` command, but it fails with `acceptance-test`, printing:
```
...
2026-08-10 17:12:34 - AcceptanceTestRunner - WARNING - Missing required benchmark categories: malformed_, oom_, sat_, timeout_, unsat_. Ensure test_formulas/ contains files with these prefixes.
2026-08-10 17:12:34 - AcceptanceTestRunner - ERROR - No test cases found in /home/tomaqa/Data/Prog/C++/smt-comp/aws-batch-comp-infrastructure-sample/test_formulas
```
But SMT formulas are located at `examples/formulas/smtlib`, not `test_formulas`. Is this part outdated?
Contributor guide
Research direction
Start by comparing the acceptance-test and test-local entry points, then inspect how AcceptanceTestRunner resolves test_formulas/ against examples/formulas/smtlib. Done means acceptance-test discovers the existing prefixed formulas and runs successfully with the parallel SMT solver.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 70/100