Fix and improve rt-tests result processing
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 9
- Forks
- 31
- Avg merge
- 3d 19h
- Merged PRs (30d)
- 16
Description
Context
Investigation following user feedback uncovered issues in the current rt-tests processing.
In particular:
• cyclictest results currently do not appear to have meaningful latency thresholds configured.
• parse_rt_tests_results.py reports latency lines as passing, with the overall result primarily determined by the cyclictest return code.
• As a result, simply providing a maximum value would not be sufficient unless the parser also understands and evaluates the threshold.
Goal
Review and improve how KernelCI interprets rt-tests, particularly cyclictest, so that reported pass/fail results represent meaningful latency expectations.
Tasks / points to investigate
• Define how cyclictest thresholds should be configured.
• Update result parsing to evaluate those thresholds.
• Ensure failures are represented correctly in KernelCI.
• Review how invocation parameters and measured values are exposed.
• Determine how this should integrate with notifications and regression reporting.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading parse_rt_tests_results.py and tracing how cyclictest invocation parameters, latency lines, return codes, and measured values become results. Clarify the threshold configuration and evaluation rules with the existing rt-tests flow, then verify that meaningful pass/fail outcomes propagate to notifications and regression reporting.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- performance, testing-qa
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100