internetarchive / internetarchive/openlibrary

Remove 40k+ amazon placeholder images

Open
#9,737 28 comments 2 reactions 1 assignee Claimed by @bhardwajparth51 View on GitHub
Lead: @RayBB Needs: Response Needs: Review Priority: 3 Type: Feature Request
Dominant language
Python
Stars
6.7k
Forks
2k
Avg merge
2d 19h
Merged PRs (30d)
138

Description

### Problem

Followup to https://github.com/internetarchive/openlibrary/issues/9156

We should remove the "no image available" images from Amazon.
Like this one: https://ia800505.us.archive.org/view_archive.php?archive=/5/items/m_covers_0012/m_covers_0012_53.zip&file=0012539916-M.jpg
![image](https://github.com/user-attachments/assets/44f8ac95-cf17-4a9e-b1b9-8806b7aec17f)

Here's a CSV of the covers with those dimensions https://github.com/user-attachments/files/16592832/covers_60_40.csv

I did a quick check and most I saw were the amazon image with md5 hash `681e43bb536038b0ecb97ed0c13b5948` but out of the 1000 I loaded I did see one that was different.

### Proposal & Constraints

### What is the proposed solution / implementation?
1. Calculate the md5 has of all the images in this CSV
2. Make a list of those with with the amazon image MD5 hash
3. interesect those cover IDs with the editions and works data dumps to figure out which editions/works need to be edited
4. Remove those covers
5. Update the import process so covers with the relevant `md5sum` value are not longer added.

### Leads

### Related files

### Stakeholders

@cdrini feel free to edit/improve this with your thoughts so this is ready for someone to work on 👍


### Instructions for Contributors

- Please [run these commands](https://github.com/internetarchive/openlibrary/wiki/Git-Cheat-Sheet#working-on-your-branch) to ensure your repository is up to date **before** [creating a new branch](https://github.com/internetarchive/openlibrary/wiki/Git-Cheat-Sheet#making-changes-and-creating-a-pull-request) to work on this issue and **each time after** pushing code to Github, because the pre-commit bot may add commits to your PRs upstream.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.