aboutcode-org / aboutcode-org/scancode-toolkit

Improve license URL detection

未关闭
#2,679 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement improve-license-detection license scan live-online-scan
主要语言
Python
星标
2.6k
派生
791
平均合并
1 天 12 小时
30 天内合并 PR
5

描述

Based on a report by @lechasseur and @armijnhemel
There is a large number of URLs that reference licenses and we have a good number of them as detection rules.
These rules are qualified as "is_license_reference"
1. It would be better to mark them as "is_license_url" so we can distinguish them
2. since there is a very large number of these possible we could optimize a secondary index and matching technique just for these
3. some of these may match patterns such things based https://github.com/remy/mit-license or license badges
- for these we may have a special way to handle patterns
4. some of these contain extra information at the referenced URL page.
- we do not want to live fetch them in scancode-toolkit, but tagging these with "is_license_url" means we could later have an optional step in scancode.io pipelines that could follow the referenced URL, fetch, save and scan them, including collecting copyrights and other useful information that may live there.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。