aboutcode-org / aboutcode-org/scancode-toolkit

Improve license URL detection

Aberta
#2,679 2 comentários 0 reações 0 responsáveis Ver no GitHub
enhancement improve-license-detection license scan live-online-scan
Linguagem predominante
Python
Estrelas
2.6k
Forks
791
Merge médio
1d 12h
PRs com merge (30d)
5

Descrição

Based on a report by @lechasseur and @armijnhemel
There is a large number of URLs that reference licenses and we have a good number of them as detection rules.
These rules are qualified as "is_license_reference"
1. It would be better to mark them as "is_license_url" so we can distinguish them
2. since there is a very large number of these possible we could optimize a secondary index and matching technique just for these
3. some of these may match patterns such things based https://github.com/remy/mit-license or license badges
- for these we may have a special way to handle patterns
4. some of these contain extra information at the referenced URL page.
- we do not want to live fetch them in scancode-toolkit, but tagging these with "is_license_url" means we could later have an optional step in scancode.io pipelines that could follow the referenced URL, fetch, save and scan them, including collecting copyrights and other useful information that may live there.

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.