[New Notebook]: Reconcile the RA datasets at NCEI vs data available through IOOS Data Catalog

Programming Language

Python

Module/Software/IOOS data service?

IOOS Data Catalog CKAN, NCEI Geoportal REST API, ISO xml metadata

Module/Software/IOOS data service?

See the following notebooks:

• https://ioos.github.io/ioos_code_lab/content/code_gallery/data_access_notebooks/2017-06-12-NCEI_RA_archive_history.html
• https://ioos.github.io/ioos_code_lab/content/code_gallery/data_access_notebooks/2024-09-17-CKAN_API_Query.html

Provide a description.

Do some matching between records at NCEI and records available through the IOOS data catalog. Essentially come up with a list of datasets that aren't at NCEI.

@ocefpaf we have published two notebooks in the CodeLab which is a start to this analysis. Linked below. I would just need to smash them together to see what we get.

1. https://ioos.github.io/ioos_code_lab/content/code_gallery/data_access_notebooks/2017-06-12-NCEI_RA_archive_history.html
2. https://ioos.github.io/ioos_code_lab/content/code_gallery/data_access_notebooks/2024-09-17-CKAN_API_Query.html

I think collecting the metadata will be easy. But, trying to match what is at NCEI to what's available from the RAs in the IOOS data catalog will be tricky. At first glance, metadata doesn't match across the two. And the frequency at which we harvest and records change in the data catalog is a moving target.