GSA / GSA/data.gov

Open Topography DCAT US 3 Harvest Source

Open
#6,197 2 comments 0 reactions 0 assignees View on GitHub
DCAT-US3 Harvester PMO
Dominant language
Python
Stars
1.1k
Forks
200
Avg merge
4h 56m
Merged PRs (30d)
5

Description

## Description

We need to create a new Metadata Harvest Source for OpenTopography in the harvesting system.
https://drive.google.com/file/d/1ywkQiveynuv6ActrMtLbc295UpQ20tCl/view?usp=drive_link

The parent organization is:

https://harvest.data.gov/organization/opentopography

This request is related to information collected through the Touchpoints Survey; however, those details should not be included in this public issue.

## Requested outcome

Create a new harvest source under the OpenTopography parent organization once the required prerequisites are met.

## Parent organization

- Organization: OpenTopography
- Existing organization page: https://harvest.data.gov/organization/opentopography

## Blockers

This work is currently blocked by the following:

- The harvester is not yet ready to harvest DCAT-US 3.
- The URL for the new OpenTopography harvest source has not yet been confirmed.

## Tasks

- [x] Confirm that the harvester supports DCAT-US 3.
- [x] Create the new Metadata Harvest Source under the OpenTopography parent organization at this source URL: https://portal.opentopography.org/csw/catalog30.json
- [x] Validate that the harvest source is configured correctly.
- [x] Run an initial harvest once the source is available and DCAT-US 3 harvesting is supported.
- [ ] Review the harvested metadata for errors or warnings.
- [ ] Confirm successful harvest completion.

## Acceptance criteria

- [ ] A new OpenTopography Metadata Harvest Source exists under the OpenTopography parent organization.
- [ ] The harvest source uses the confirmed OpenTopography source URL.
- [ ] The source is configured for DCAT-US 3 harvesting, if applicable.
- [ ] An initial harvest has completed successfully.
- [ ] Any harvest errors or validation issues have been reviewed and documented.

## Notes

Private request details are available internally through the Touchpoints Survey response and should not be included in this public issue. See https://drive.google.com/file/d/1ywkQiveynuv6ActrMtLbc295UpQ20tCl/view?usp=drive_link

This should be completed as soon as possible after the DCAT-US 3 harvester capability is available and the new harvest source URL has been confirmed.

Contributor guide

Open the contributing guide

Research direction

Start by checking the data.gov harvesting system's DCAT-US 3 support and the OpenTopography organization page at harvest.data.gov/organization/opentopography. Verify the source URL https://portal.opentopography.org/csw/catalog30.json, confirm the source configuration, run the initial harvest, and review and document any errors or warnings.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.