aboutcode-org / aboutcode-org/purldb

mass-scan: Refactor PurlDB to efficiently process 100+ million project scans using partitioned databases

Open
#568 2 comments 0 reactions 1 assignee Claimed by @JonoYang View on GitHub
Dominant language
HTML
Stars
67
Forks
69
Avg merge
8d 8h
Merged PRs (30d)
1

Description

We are going to process a large number of scans for many packages. We should refactor PurlDB to efficiently process 100+ million project scans using partitioned databases, likely split by package type and ecosystems. It coulc mean multiple PurlDB instances too.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.