Feature Request/Idea: Make OAI-PMH harvesting more configurable
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 1.1k
- Forks
- 564
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 29
Description
Overview of the Feature Request
The idea is to make it possible to make OAI-PMH metadata harvesting more configurable, so that 1) the metadata about the datasets included in a given harvesting set can come from any selection of fields from any metadata schema defined in a Dataverse installation, and 2) the metadata can be based on other standards than Dublin Core (DC). See discussion in Dataverse Users Community Google Group.
What kind of user is the feature intended for?
API User, Superuser, Sysadmin
What inspired the request?
DataverseNO would like to implement interoperability support for data to be made searchable and reusable through the Svalbard Integrated Arctic Earth Observing System (SIOS), which is an international observing system for long-term measurements in and around the Norwegian archipelago of Svalbard addressing Earth System Science questions. There is a growing community in Europe and beyond who makes or is interested in making their data reusable through SIOS. Currently, SIOS only supports harvesting of discovery metadata using OAI-PMH.
What existing behavior do you want changed?
Currently, Dataverse supports OAI-PMH harvesting using a DC representation of (some of?) the metadata in the Citation Metadata block.
Any brand new behavior you want to add to Dataverse?
Yes, the requested feature would extend the possibility of how to configure OAI-PMH metadata harvesting.
Any open or closed issues related to this feature request?
Some of the issues below might be related:
IQSS/dataverse:
- https://github.com/IQSS/dataverse/issues/10196#issuecomment-1883267019
- https://github.com/IQSS/dataverse/issues/6243#issuecomment-538938350
- https://github.com/IQSS/dataverse/issues/5960
- https://github.com/IQSS/dataverse/issues/3699
- https://github.com/IQSS/dataverse/issues/4451
- https://github.com/IQSS/dataverse/issues/1592
- #2721
IQSS/dataverse-pm:
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing Dataverse's existing OAI-PMH harvesting behavior and the linked related issues and community discussion. Done would mean defining and implementing configuration that selects fields from any installed metadata schema and supports standards beyond Dublin Core.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- api, backend-api-design
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100