checkstyle / checkstyle/regression-tool

Regression on code changes and message changes

Open
#68 0 comments 0 reactions 1 assignee Claimed by @Luolc View on GitHub
Dominant language
Java
Stars
9
Forks
6
PR merge metrics
No merged PRs in 30d

Description

Identified in PR https://github.com/checkstyle/checkstyle/pull/4903 ,

If a PR makes changes to Check logic and changes to a existing message, normal regression will display too many differences as all will be centered around change in message and it will be impossible/hard to discern if any where from code changes.

In this situation, we should force check's message to a specific message for both base and patch runs so only the differences in the code is examined.
Example of configuration for the PR mentioned:
````








````
Notice the message is only for `summary.first.sentence` as that was what was modified in the PR.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.