kernelci / kernelci/kernelci-core

Detect if the kselftest suite has been moved or renamed and report failures instead of success

Open
#1,787 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
120
Forks
107
Avg merge
1d 2h
Merged PRs (30d)
21

Description

Kselftest vm test suite has been renamed to mm. But we didn't get any failure in kernelci results (https://staging.kernelci.org/test/job/next/branch/master/kernel/next-20230306/plan/kselftest-vm/). Kernelci should have reported failure which would have been an indication for the developers to investigate and do renaming in kernelci as well.

I was manually checking selftests results on kernelci and found this out. I've raised a PR (https://github.com/kernelci/kernelci-core/pull/1786) to fix this.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing how KernelCI handles the kselftest vm suite and compare the renamed mm suite behavior. Inspect pull request 1786 for the existing fix. Done means a moved or renamed suite produces a failure in KernelCI results instead of being reported as successful.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing-qa
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.