aboutcode-org / aboutcode-org/scancode-toolkit

Master issue: Improve ScanCode resources usage (CPU, RAM, Disk)

Đang mở
#3,755 2 bình luận 1 reaction 0 người được giao Xem trên GitHub
Ngôn ngữ chính
Python
Star
2.6k
Fork
791
Merge trung bình
1 ngày 12 giờ
Pull request đã merge (30 ngày)
5

Mô tả

It would be great to optimize resources usage.
In particular, these are the likely key hot spots:
- memory as used in license detection (was typically 0.8 GB now closer to 1.5GB per process)
- memory when return large JSON scans (which are all re-loaded in memory assembled from the cache)
- CPU when running copyright detection
- CPU when running license detection

Some related issues:
- [ ] https://github.com/nexB/scancode-toolkit/issues/2725
- [ ] https://github.com/nexB/scancode-toolkit/issues/1950
- [ ] https://github.com/nexB/scancode-toolkit/issues/3711
- [ ] https://github.com/nexB/scancode-toolkit/issues/1894
- [ ] https://github.com/nexB/scancode-toolkit/issues/3593
- [ ] https://github.com/nexB/scancode-toolkit/issues/2547
- [ ] https://github.com/nexB/scancode-toolkit/issues/1014
- [ ] https://github.com/nexB/scancode-toolkit/issues/1809
- [ ] https://github.com/nexB/scancode-toolkit/issues/3143

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.