NVIDIA / NVIDIA/ai-cloud-validation
bug: K8sCncfConformanceCheck: shipped quick mode filter matches nothing and an all-skipped run passes
Open
Beginner friendly
Nobody has claimed this yet.
bug
kubernetes
priority-0
- Dominant language
- Python
- Stars
- 27
- Forks
- 33
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 28
Description
The shipped mode: quick test filter is malformed and matches nothing, and an all-skipped run scores as a pass — reported as one green line. Not confirmed live; worth an hour on kind first.
(Note - Not confirmed live).
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the shipped quick-test filter in isvctl/configs/suites/k8s.yaml at the linked line, then trace how K8sCncfConformanceCheck reports an all-skipped run. Reproduce the behavior on kind as suggested; done means quick mode selects its intended tests and an all-skipped run no longer reports a pass.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- kubernetes, python, yaml
- Domain
- devops, testing-qa
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 72/100