aim-rsf / aim-rsf/cprd-data-wrangle

Machine-readable metadata not available

Offen
#25 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
help wanted question
Vorherrschende Sprache
Jupyter Notebook
Sterne
12
Forks
0
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

CPRD's metadata (also known as [data specifications](https://www.cprd.com/sites/default/files/2022-02/CPRD%20Aurum%20Data%20Specification%20v2.7%20%28002%29.pdf)) contain all the info we want for this pipeline but they are in PDF. Some of the steps in the current repo, manually copy and paste the metadata from PDF to CSV (machine-readable format) - this is not ideal as it is prone to error, takes time, and is not too scalable (for example, if there is an update to the metadata).

It would be great to access machine-readable structural metadata, for example like the files hosted on the [HDRUK Gateway](https://healthdatagateway.org/en/dataset/692) however the file only contains 'column name' not 'field name' (and field name is the one that is in the data files), the order of the columns are different in the metadata compared to the real/synthetic data files, and we do not know if it is kept up to date.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.