layer5io / layer5io/learn-layer5
[SMI] Failure of one conformance test crashes the test suite
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 72
- Forks
- 35
- PR merge metrics
- No merged PRs in 30d
Description
Description
Failure of one SMI Conformance test crashes the tool and the rest of the conformance tests. The tool exits without cleaning up, but leaves resources orphaned. Instead the program should cleanup any test resources before exiting.
Expected Behavior
It makes sense that the tool might have a cascading failure for one set of tests, because one test builds on another within a set, but the tool shouldn't crash. Other test sets should continue to execute. Test resources should not be orphaned.
Environment:
- Version: meshery-osm adapter v0.1.4
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the failure in the meshery-osm adapter's SMI Conformance test tool and trace how one failed test ends execution. Verify the runner's cleanup and continuation behavior across test sets; done means failed tests no longer crash the tool, later sets execute, and test resources are not orphaned.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- devops, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100