IQSS / IQSS/dataverse

Harvesting: a bug in dataset update (UpdateHarvestedDatasetCommand)

Open
#11,933 1 comment 0 reactions 1 assignee View on GitHub

@landreev is already working on this.

Since Aug 27, 2026.

Feature: Harvesting FY27 Priority FY27 Roadmap GREI 3 GREI Year 5 Original size: 20 Type: Bug
Dominant language
Java
Stars
1.1k
Forks
564
Avg merge
2d 2h
Merged PRs (30d)
29

Description

This is a direct side effect of an optimization introduced in IQSS/dataverse#10836
I made an effort there to only update things that have changed since the last harvest, specifically when it came to harvested files, and apparently created a bug in the process:

Exception processing getRecord(), oaiUrl=https://borealisdata.ca/oai, identifier=doi:10.34990/FK2/TVUWWT,
 edu.harvard.iq.dataverse.api.imports.ImportException, Failed to import harvested dataset: class 
edu.harvard.iq.dataverse.engine.command.exception.CommandException (Command 
edu.harvard.iq.dataverse.engine.command.impl.UpdateHarvestedDatasetCommand@5e1a3886 failed: 
Exception thrown from bean: java.lang.IllegalArgumentException: Cannot merge an Entity that has been 
removed: edu.harvard.iq.dataverse.FileMetadata[id=8812744])

From the look of it, should be easy enough to fix.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.