IQSS / IQSS/dataverse

Too many S3 requests to dataset_logo_original for dataset thumbnail

Open
#11,973 7 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Original size: 3 Type: Bug
Dominant language
Java
Stars
1.1k
Forks
564
Avg merge
2d 2h
Merged PRs (30d)
29

Description

What steps does it take to reproduce the issue?

  • When does this issue occur?

When trying to load a dataset thumbnail and the dataset author/admin didn't define a thumbnail.

  • Which page(s) does it occurs on?

It occurs on pages that require a dataset thumbnail on load.

  • What happens?

Dataverse tries to access a S3 file that doesn't exist, this creates a lot of unwanted requests to the S3 endpoint.

  • To whom does it occur (all users, curators, superusers)?

All users.

  • What did you expect to happen?

I have configure the feature flag disable-dataset-thumbnail-autoselect to On, but documentation isn't clear on the full effects of this setting. In dataset table there is a column usegenericthumbnail, but the Thumbnail+Widgets page for datsets doesn't have a way to enable this setting. Is this option configured by this feature flag?
I have also configured S3 following this section of the documentation, but in the same table the column storagedrive is set to null for all entries. Shouldn't this have the storage driver ID configured ?

Which version of Dataverse are you using?
6.6

Any related open or closed issues to this bug report?
No

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing dataset thumbnail loading for datasets without an author or admin thumbnail, then inspect the disable-dataset-thumbnail-autoselect feature flag and the dataset table fields usegenericthumbnail and storagedrive. Reproduce the missing S3 object lookup and verify that thumbnail loading avoids repeated requests while the flag and storage-driver behavior are clear.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, java
Domain
backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.