aboutcode-org / aboutcode-org/scancode-toolkit

Scan freezes when scanning big repositories (dotnet/corefx or dotnet/runtime)

未關閉
#4,508 8 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
bug
主要語言
Python
星號
2.6k
分支
791
平均合併
1 天 12 小時
30 天內合併 PR
5

描述

### Description

I'm running ScanCode v32.4.0 under Windows with Python v3.10. We're running ScanCode for .NET OSS dependencies using OSS Review Toolkit (ORT). We have some dependencies to libraries from Microsoft, stored in dotnet/runtime and dotnet/corefx GitHub repos. Both repositories are really big. Unfortunately, even if ORT configured to use the certain path inside of this repository (e.g. src/System.Threading.Tasks.Extensions), ORT starts a scan of the whole repository. However, running ORT on my PC for the whole repository results in freezing of ScanCode after certain time (20 minutes). E.g. running for commit: https://github.com/dotnet/corefx/tree/7601f4f6225089ffb291dc7d58293c7bbf5c5d4f/
Windows doesn't detect the python.exe as hanging or frozen, howeve raccording to console outputs, no progress happens even after many hours or days. If I scan the subfolders of big repository separately, the problem doesn't happen.

### How To Reproduce

Checkout commit "https://github.com/dotnet/corefx/tree/7601f4f6225089ffb291dc7d58293c7bbf5c5d4f/"
Run ScanCode:
`scancode.bat --info --copyright --license --verbose --strip-root --timeout 5 --ignore "*.sln" --ignore "*.csproj" --ignore "*.htm" --ignore "*.html" --ignore "*.pdf" --processes 6 --license-references --spdx-tv D:\Temp\result.yml "{PATH_TO_REVISION_CHECKOUT}"`

After about 10-30 minutes there will be no progress for scan code.

### System configuration

* What OS are you running on? Windows
* What version of scancode-toolkit was used to generate the scan file? v32.4.0
* What installation method was used to install/run scancode? (pip/source download/other): binary download

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。