aboutcode-org / aboutcode-org/scancode-toolkit

Scan freezes when scanning big repositories (dotnet/corefx or dotnet/runtime)

Aberta
#4,508 8 comentários 0 reações 0 responsáveis Ver no GitHub
bug
Linguagem predominante
Python
Estrelas
2.6k
Forks
791
Merge médio
1d 12h
PRs com merge (30d)
5

Descrição

### Description

I'm running ScanCode v32.4.0 under Windows with Python v3.10. We're running ScanCode for .NET OSS dependencies using OSS Review Toolkit (ORT). We have some dependencies to libraries from Microsoft, stored in dotnet/runtime and dotnet/corefx GitHub repos. Both repositories are really big. Unfortunately, even if ORT configured to use the certain path inside of this repository (e.g. src/System.Threading.Tasks.Extensions), ORT starts a scan of the whole repository. However, running ORT on my PC for the whole repository results in freezing of ScanCode after certain time (20 minutes). E.g. running for commit: https://github.com/dotnet/corefx/tree/7601f4f6225089ffb291dc7d58293c7bbf5c5d4f/
Windows doesn't detect the python.exe as hanging or frozen, howeve raccording to console outputs, no progress happens even after many hours or days. If I scan the subfolders of big repository separately, the problem doesn't happen.

### How To Reproduce

Checkout commit "https://github.com/dotnet/corefx/tree/7601f4f6225089ffb291dc7d58293c7bbf5c5d4f/"
Run ScanCode:
`scancode.bat --info --copyright --license --verbose --strip-root --timeout 5 --ignore "*.sln" --ignore "*.csproj" --ignore "*.htm" --ignore "*.html" --ignore "*.pdf" --processes 6 --license-references --spdx-tv D:\Temp\result.yml "{PATH_TO_REVISION_CHECKOUT}"`

After about 10-30 minutes there will be no progress for scan code.

### System configuration

* What OS are you running on? Windows
* What version of scancode-toolkit was used to generate the scan file? v32.4.0
* What installation method was used to install/run scancode? (pip/source download/other): binary download

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.