aboutcode-org / aboutcode-org/scancode-toolkit

Improve license URL detection

Offen
#2,679 2 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
enhancement improve-license-detection license scan live-online-scan
Vorherrschende Sprache
Python
Sterne
2.6k
Forks
791
Ø Merge
1 T. 12 Std.
Gemergte PRs (30 T.)
5

Beschreibung

Based on a report by @lechasseur and @armijnhemel
There is a large number of URLs that reference licenses and we have a good number of them as detection rules.
These rules are qualified as "is_license_reference"
1. It would be better to mark them as "is_license_url" so we can distinguish them
2. since there is a very large number of these possible we could optimize a secondary index and matching technique just for these
3. some of these may match patterns such things based https://github.com/remy/mit-license or license badges
- for these we may have a special way to handle patterns
4. some of these contain extra information at the referenced URL page.
- we do not want to live fetch them in scancode-toolkit, but tagging these with "is_license_url" means we could later have an optional step in scancode.io pipelines that could follow the referenced URL, fetch, save and scan them, including collecting copyrights and other useful information that may live there.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.