GSA / GSA/data.gov

DOS DCAT US 3 Harvest Source

Open
#6,244 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
200
Avg merge
4h 56m
Merged PRs (30d)
5

Description

Description
We need to create a new Metadata Harvest Source for the Social Security Administration (SSA) in the harvesting system.

The parent organization is: https://harvest.data.gov/organization/state

This request is related to information collected through the Touchpoints Survey; however, those details should not be included in this public issue.

Requested outcome
Create a new harvest source under the agency parent organization once the required prerequisites are met.

Parent organization
Organization: Dept of State
Existing organization page: https://harvest.data.gov/organization/state

Confirm the new harvest source URL for SSA. https://www.state.gov/data.json (keep same JSON and update DCAT version)

Run an initial harvest once the source is available and DCAT-US 3 harvesting is supported.

Review the harvested metadata for errors or warnings.

The source is configured for DCAT-US 3 harvesting, if applicable.

An initial harvest has completed successfully.

Any harvest errors or validation issues have been reviewed and documented.
Notes
Private request details are available internally through the Touchpoints Survey response and should not be included in this public issue. Details can be found here: https://drive.google.com/file/d/1jc07jxGXHUeRJg26iplxzilg7n_bqy-O/view?usp=drive_link

This should be completed as soon as possible after the DCAT-US 3 harvester capability is available and the new harvest source URL has been confirmed.

Contributor guide

Open the contributing guide

Research direction

Start at the harvesting system entry point and verify whether DCAT-US 3 harvesting is supported. Confirm the SSA source URL and parent organization before creating the source, then run an initial harvest and review and document any errors, warnings, or validation issues.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.