Open Topography DCAT US 3 Harvest Source
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 200
- Avg merge
- 4h 56m
- Merged PRs (30d)
- 5
Description
## Description
We need to create a new Metadata Harvest Source for OpenTopography in the harvesting system.
https://drive.google.com/file/d/1ywkQiveynuv6ActrMtLbc295UpQ20tCl/view?usp=drive_link
The parent organization is:
https://harvest.data.gov/organization/opentopography
This request is related to information collected through the Touchpoints Survey; however, those details should not be included in this public issue.
## Requested outcome
Create a new harvest source under the OpenTopography parent organization once the required prerequisites are met.
## Parent organization
- Organization: OpenTopography
- Existing organization page: https://harvest.data.gov/organization/opentopography
## Blockers
This work is currently blocked by the following:
- The harvester is not yet ready to harvest DCAT-US 3.
- The URL for the new OpenTopography harvest source has not yet been confirmed.
## Tasks
- [x] Confirm that the harvester supports DCAT-US 3.
- [x] Create the new Metadata Harvest Source under the OpenTopography parent organization at this source URL: https://portal.opentopography.org/csw/catalog30.json
- [x] Validate that the harvest source is configured correctly.
- [x] Run an initial harvest once the source is available and DCAT-US 3 harvesting is supported.
- [ ] Review the harvested metadata for errors or warnings.
- [ ] Confirm successful harvest completion.
## Acceptance criteria
- [ ] A new OpenTopography Metadata Harvest Source exists under the OpenTopography parent organization.
- [ ] The harvest source uses the confirmed OpenTopography source URL.
- [ ] The source is configured for DCAT-US 3 harvesting, if applicable.
- [ ] An initial harvest has completed successfully.
- [ ] Any harvest errors or validation issues have been reviewed and documented.
## Notes
Private request details are available internally through the Touchpoints Survey response and should not be included in this public issue. See https://drive.google.com/file/d/1ywkQiveynuv6ActrMtLbc295UpQ20tCl/view?usp=drive_link
This should be completed as soon as possible after the DCAT-US 3 harvester capability is available and the new harvest source URL has been confirmed.
Contributor guide
Research direction
Start by checking the data.gov harvesting system's DCAT-US 3 support and the OpenTopography organization page at harvest.data.gov/organization/opentopography. Verify the source URL https://portal.opentopography.org/csw/catalog30.json, confirm the source configuration, run the initial harvest, and review and document any errors or warnings.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100