internetarchive / internetarchive/openlibrary
Remove 40k+ amazon placeholder images
- Dominant language
- Python
- Stars
- 6.7k
- Forks
- 2k
- Avg merge
- 2d 19h
- Merged PRs (30d)
- 138
Description
### Problem
Followup to https://github.com/internetarchive/openlibrary/issues/9156
We should remove the "no image available" images from Amazon.
Like this one: https://ia800505.us.archive.org/view_archive.php?archive=/5/items/m_covers_0012/m_covers_0012_53.zip&file=0012539916-M.jpg

Here's a CSV of the covers with those dimensions https://github.com/user-attachments/files/16592832/covers_60_40.csv
I did a quick check and most I saw were the amazon image with md5 hash `681e43bb536038b0ecb97ed0c13b5948` but out of the 1000 I loaded I did see one that was different.
### Proposal & Constraints
### What is the proposed solution / implementation?
1. Calculate the md5 has of all the images in this CSV
2. Make a list of those with with the amazon image MD5 hash
3. interesect those cover IDs with the editions and works data dumps to figure out which editions/works need to be edited
4. Remove those covers
5. Update the import process so covers with the relevant `md5sum` value are not longer added.
### Leads
### Related files
### Stakeholders
@cdrini feel free to edit/improve this with your thoughts so this is ready for someone to work on 👍
### Instructions for Contributors
- Please [run these commands](https://github.com/internetarchive/openlibrary/wiki/Git-Cheat-Sheet#working-on-your-branch) to ensure your repository is up to date **before** [creating a new branch](https://github.com/internetarchive/openlibrary/wiki/Git-Cheat-Sheet#making-changes-and-creating-a-pull-request) to work on this issue and **each time after** pushing code to Github, because the pre-commit bot may add commits to your PRs upstream.
Contributor guide
Assessment
This issue has not been assessed yet.