aboutcode-org / aboutcode-org/scancode-analyzer
Scale up to Large Datasets
未关闭
- 主要语言
- Python
- 星标
- 4
- 派生
- 4
- PR 合并指标
- 30 天内没有已合并 PR
描述
Research in the Pipeline
1. IO speed Analysis
2. Multi-Threading Functionality
3. Computation Bottlenecks
4. Memory/Processing Profiling
5. System Specific Changes in parameters
6. Chunking data and Batching Tasks
So that the pipeline can be effectively and efficiently scaled to very large datasets, to perform the analysis on the whole Clearly Defined Dataset.
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。