aboutcode-org / aboutcode-org/scancode-analyzer
Scale up to Large Datasets
未關閉
- 主要語言
- Python
- 星號
- 4
- 分支
- 4
- PR 合併指標
- 30 天內沒有已合併 PR
描述
Research in the Pipeline
1. IO speed Analysis
2. Multi-Threading Functionality
3. Computation Bottlenecks
4. Memory/Processing Profiling
5. System Specific Changes in parameters
6. Chunking data and Batching Tasks
So that the pipeline can be effectively and efficiently scaled to very large datasets, to perform the analysis on the whole Clearly Defined Dataset.
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。