GSA / GSA/data.gov

SSA DCAT US 3 Harvest Source

Open
#6,198 10 comments 1 reaction 0 assignees View on GitHub
DCAT-US3 Harvester PMO
Dominant language
Python
Stars
1.1k
Forks
200
Avg merge
4h 56m
Merged PRs (30d)
5

Description

## Description

We need to create a new Metadata Harvest Source for the Social Security Administration (SSA) in the harvesting system.

The parent organization is:

https://harvest.data.gov/organization/ssa

This request is related to information collected through the Touchpoints Survey; however, those details should not be included in this public issue.

## Requested outcome

Create a new harvest source under the SSA parent organization once the required prerequisites are met.

## Parent organization

- Organization: Social Security Administration
- Existing organization page: https://harvest.data.gov/organization/ssa

## Blockers

This work is currently blocked by the following:

1. The harvester is not yet ready to harvest DCAT-US 3.
2. The URL for the new SSA harvest source has not yet been confirmed.

## Tasks

- [ ] Confirm the new harvest source URL for SSA.
- [ ] Confirm that the harvester supports DCAT-US 3.
- [ ] Create the new Metadata Harvest Source under the SSA parent organization.
- [ ] Validate that the harvest source is configured correctly.
- [ ] Run an initial harvest once the source is available and DCAT-US 3 harvesting is supported.
- [ ] Review the harvested metadata for errors or warnings.
- [ ] Confirm successful harvest completion.

## Acceptance criteria

- [ ] A new SSA Metadata Harvest Source exists under the SSA parent organization.
- [ ] The harvest source uses the confirmed SSA source URL.
- [ ] The source is configured for DCAT-US 3 harvesting, if applicable.
- [ ] An initial harvest has completed successfully.
- [ ] Any harvest errors or validation issues have been reviewed and documented.

## Notes

Private request details are available internally through the Touchpoints Survey response and should not be included in this public issue. Details can be found here: https://drive.google.com/file/d/1jc07jxGXHUeRJg26iplxzilg7n_bqy-O/view?usp=drive_link

This should be completed as soon as possible after the DCAT-US 3 harvester capability is available and the new harvest source URL has been confirmed.

Contributor guide

Open the contributing guide

Research direction

Start with the SSA organization page at https://harvest.data.gov/organization/ssa and confirm the source URL and DCAT-US 3 harvester support, since both are listed blockers. No repository file or test is named; once the prerequisites are available, configure the new Metadata Harvest Source under SSA, run an initial harvest, and review its errors, warnings, and completion status.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.