aboutcode-org / aboutcode-org/scancode.io

Deduplicate packages in discoveredpackage worksheet

Open
#77 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
215
Forks
203
Avg merge
4d 8h
Merged PRs (30d)
6

Description

The discoveredpackage worksheet from a ScanPipe scan often has duplicate entries for the same purl. I suspect that the number of rows for such a purl reflects the number of resources for that package in the codebaseresources worksheet. In most cases these are exact duplicates, but in some cases one record may have more information (e.g. Description and some additional URLs for bug_tracking, vcs or similar. We should consider deduplicating so that we have one record per purl (preferably the one with the most complete data).

We might want to provide a count of the number of records that have been deduplicated, but I am not sure how important that is.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.