aboutcode-org / aboutcode-org/scancode-toolkit

Reduce license detection false positives

未關閉
#3,300 0 則留言 0 個 reaction 已指派 1 人 已被 @AyanSinhaMahapatra 認領 在 GitHub 檢視
enhancement license scan major Priority: high
主要語言
Python
星號
2.6k
分支
791
平均合併
1 天 12 小時
30 天內合併 PR
5

描述

This issue summarizes remaining work on scancode license detection false positives:

1. Adding required phrases in all scancode license detection rules: #3254
2. Integrating the unknown license detection `--unknown-licenses` step in a better way with the current license detection post processing such that it is always used in the cases where we have no detections or sub-par detections with multiple fragmented matches. This is complementary to step 1. as it is restricts false positive detections, but also increases false negatives, by discarding approximate matches, and to cover there, we need the unknown license detection, to make sure we don't lose the good things about scancode license detection: strong approximate matching.

There are two main steps/solution elements here, which are WIP/already implemented. But we need to put them together in a more effective way and test this better to make sure we're doing much better on false positives and to also prove that we are not failing to detect any piece of license related test due to the stricter restrictions put on the detection rules.

Further follow up is required to test/validate that false positives were actually reduced:

1. To test, we will run license detection on existing scancode license rules selectively such that we run license detection on a group of rules with a specific `license_expression`, and we configure scancode to run with a license index such that rules of this particular `license_expression` is not present, but all other rules are indexed there.
3. We also need to do a review pass on all the open license detection related issues and make sure they are fixed/closed or summarized into more action items.

See also the long-running RFC issue on this topic: #2878, which has two more action items:

1. This issue
2. #2402

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。