commercetest / commercetest/nlnet

TBD Quantitative indicators of data quality

Open
#11 1 comment 0 reactions 0 assignees View on GitHub
documentation enhancement question
Dominant language
Python
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

### Context
We are already discovering flaws with some of the project data e.g. where the URL for the project's repository doesn't map to a current repo. (See https://github.com/commercetest/nlnet/issues/3 for various examples of the issues.)

Currently we skip many of these entries since we cannot discern which repo to query for tests. It may be useful to track and report these flaws e.g. to the team at NLnet with the aim of improving the upstream data about the projects.

The reporting might as well be in RDF format to facilitate automated consumption of the information. Therefore the results need to be in three column format AFAIK. TBD what information we can usefully provide and how to encode the results e.g. when would a binary result be acceptable (e.g. `valid|invalid`) vs. more nuanced results (e.g. `accessed_ok|unrecognised_as_a_code_repo|HTTP Error{nnn} received`)?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing issue #3 and the current handling of entries whose repository URLs cannot be mapped to a current repository. Determine which data-quality flaws can be observed and what RDF three-column results should report, including whether statuses should be binary or nuanced. The issue is complete when the indicators and output encoding are agreed and implementable.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.