dotnet / dotnet/source-build

Investigate options to improve license scanning efficiency

Open
#5,383 1 comment 0 reactions 0 assignees View on GitHub
area-testing
Dominant language
No language data
Stars
287
Forks
145
Avg merge
1d 22h
Merged PRs (30d)
10

Description

License scanning takes a long time: ~19 hrs total compute per run. We should investigate ways to reduce this time.

One idea is to stop scanning stuff that's already been scanned before. Assuming that the version of scancode since the last time a file has been scanned, it makes no sense to scan it again over and over and over. Some ways to avoid doing that:
* A pipeline run outputs as artifacts the git commit URL of the file that was scanned (which includes the commit SHA to uniquely identify that version of the file). A subsequent pipeline run checks the artifacts of the previous pipeline run and compares the commit URLs of the files to what the branch currently has. The scan only runs on those files which have changed.
* A pipeline run does a git diff to determine the file changes from the current run and the last pipeline run. The scan runs only on that diff.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.