aboutcode-org / aboutcode-org/scancode-toolkit

Improve license URL detection

未關閉
#2,679 2 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
enhancement improve-license-detection license scan live-online-scan
主要語言
Python
星號
2.6k
分支
791
平均合併
1 天 12 小時
30 天內合併 PR
5

描述

Based on a report by @lechasseur and @armijnhemel
There is a large number of URLs that reference licenses and we have a good number of them as detection rules.
These rules are qualified as "is_license_reference"
1. It would be better to mark them as "is_license_url" so we can distinguish them
2. since there is a very large number of these possible we could optimize a secondary index and matching technique just for these
3. some of these may match patterns such things based https://github.com/remy/mit-license or license badges
- for these we may have a special way to handle patterns
4. some of these contain extra information at the referenced URL page.
- we do not want to live fetch them in scancode-toolkit, but tagging these with "is_license_url" means we could later have an optional step in scancode.io pipelines that could follow the referenced URL, fetch, save and scan them, including collecting copyrights and other useful information that may live there.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。