aboutcode-org / aboutcode-org/scancode-toolkit
Consolidating large codebases uses excessive amounts of memory
Ouverte
bug
summaries
- Langage dominant
- Python
- Étoiles
- 2.6k
- Forks
- 791
- Merge moyen
- 1 j 12 h
- PR mergées (30 j)
- 5
Description
I was using the consolidation plugin on a 18.3 mb scan with 14886 files and scancode managed to use 10+ gigs of ram. I have a feeling that it is this dict (https://github.com/nexB/scancode-toolkit/blob/develop/src/summarycode/plugin_consolidate.py#L391) bloating up horribly when there are a lot of copyright holders consolidated.
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.