aboutcode-org / aboutcode-org/scancode-toolkit
Feature Request: Parallalize all steps of scancode if possible
- 主要語言
- Python
- 星號
- 2.6k
- 分支
- 791
- 平均合併
- 1 天 12 小時
- 30 天內合併 PR
- 5
描述
## Short Description
In all but the file scanning step, scancode only uses one core, resulting in a low CPU load and a long runtime.
## Select Category
- [X] Enhancement
## **How This Feature will help you/your organization**
It should reduce the overall runtime substantially.
## **Possible Solution/Implementation Details**
I started scancode on a large codebase with parameter _-n 30_. After two hours (on a 32 core CPU), it was still in the state _Collect file inventory..._. The entire code base is on a M.2 SSD. The task manager shows little CPU, Memory, and IO activity.
Please parallelize all steps of scancode, including the file collection step.
## **Hardware / Software used**
AMD Ryzen 9 3950X (16 core, 32 thread), 32GB RAM, M.2 SSD 970 EVO Plus 1TB
Windows 10 Enterprise LTSC (1809), Python 3.9, Scancode 30.0.0
貢獻指南
評估
這個 Issue 還沒有評估資料。