aboutcode-org / aboutcode-org/scancode-toolkit

Package scan for open source component detects 940mb of duplicated information

Đang mở
#2,915 2 bình luận 0 reaction 0 người được giao Xem trên GitHub
bug package scan
Ngôn ngữ chính
Python
Star
2.6k
Fork
791
Merge trung bình
1 ngày 12 giờ
Pull request đã merge (30 ngày)
5

Mô tả

### Description

We encountered an issue trying to scan the following open source component: [RxDataSources - 4.0.1](https://github.com/RxSwiftCommunity/RxDataSources/tree/4.0.1)

When doing a scan with the package information enabled it detects about 940MB of package information in the file [RxDataSources.podspec](https://github.com/RxSwiftCommunity/RxDataSources/blob/4.0.1/RxDataSources.podspec).

The output (the value of the package field in the resulting json file for this specific file) looks like this, Scancode seems to catch on the same line multiple times:
![image](https://user-images.githubusercontent.com/10448053/162915364-07e71b8a-d992-49ac-a3e8-bc14b3939339.png)

### How To Reproduce

Download sourcecode from [RxDataSources - 4.0.1](https://github.com/RxSwiftCommunity/RxDataSources/tree/4.0.1)
Run Scancode on the sourcecode with package information enabled

The exact command we are using:
scancode -clpi --license-score 65 --max-in-memory -1 -n 4 --strip-root --verbose --json-pp ./out.json path/to/sourcecode

### System configuration

* What OS are you running on? Tested on both Windows and dockerized Linux
* What version of scancode-toolkit was used to generate the scan file? [scancode-toolkit-30.1.0_py36-windows.zip](https://github.com/nexB/scancode-toolkit/releases/download/v30.1.0/scancode-toolkit-30.1.0_py36-windows.zip) for Windows and [scancode-toolkit-30.1.0_py36-linux.tar.xz](https://github.com/nexB/scancode-toolkit/releases/download/v30.1.0/scancode-toolkit-30.1.0_py36-linux.tar.xz) for Linux.
* What installation method was used to install/run scancode? For windows: Source download. For Linux: Source download -> Docker build

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.