aboutcode-org / aboutcode-org/scancode.io
Run a package-only scan on a codebase as a new pipeline - Proactively scan and review all my packages
- 主要語言
- Python
- 星號
- 215
- 分支
- 203
- 平均合併
- 4 天 8 小時
- 30 天內合併 PR
- 6
描述
Following https://github.com/nexB/scancode.io/issues/720 and https://github.com/nexB/purldb/issues/87 we need to have a pipeline that would only populate the packages and dependencies (and eventually later on also resolve dependencies)
The goal is to ensure that the purlDB is kept always up-to-date with the set of packages effectively used in a development codebase.
The overall process would be:
- [ ] #828
- There, either clone and checkout or download the latest commit of a codebase
- Run a new pipeline that only collects the packages minimally, for now using whatever pipes we have.
- In the future we should be using a skinny PURL only approach
- [x] nexB/scancode-toolkit#3464
- Once this pipeline is complete, run a second "populate_purldb" pipeline https://github.com/nexB/scancode.io/blob/3ed1e9e0fd7bf0fd9e978522e6365e33ee156ef8/scanpipe/pipelines/populate_purldb.py .... this will trigger indexing and scanning there.
Separately I would like to have a way to determine if any of the package populated in the purlDB here has any license or origin issues based on data clarity and accuracy (using summaries, scores, --todo, package set, policies, compliance alerts, etc. and TBD )and I want to be alerted to review and eventually curate the issues that were uncovered, by exception.
Ideally there would be some minimal request/ticket system where a form would be posted for any item that would need further review. The ideal outcome would be to push and store a curated version of the package data (possibly in the purldB as part of a package set with a "curated" type) , or some ABOUT file that I could download to save in my codebase.
貢獻指南
評估
這個 Issue 還沒有評估資料。