internetarchive / internetarchive/openlibrary

Automatically archive added links at the IA

Open
#9,474 1 comment 1 reaction 0 assignees View on GitHub
Lead: @mekarpeles Priority: 3 Type: Feature Request
Dominant language
Python
Stars
6.7k
Forks
2k
Avg merge
2d 19h
Merged PRs (30d)
138

Description

### Problem

Librarians add links to OL items. These links will break. There is not always an archived version as a replacement.

### A clear and concise description of what you want to happen

The Open Library works page as well as the author page have an option to add links (to reviews, etc.). Whenever I add a link, the linked page should automatically be archived at the IA. When the site goes away, there will be an archived version that can be used instead of the live link. (Ideally, the replacement of a dead link with the archived link should happen automatically, too, but that is beyond the scope of this feature request.)

In the absence of such a mechanism, librarians will have to add the links to the IA manually, and that seems a waste of human work.

### Expected behaviour / screenshots (ex: Figma design screenshots for UI feature)

### Additional Context

### Proposal & Constraints

### What is the proposed solution / implementation?

- Automatically save the linked page to IA whenever a link is added to an OL item.

- Ideally, even save all pages from existing links in OL items to IA once, right now. They will be needed sooner rather than later.

- Economy version of this proposal: Implement some sort of cronjob that archives all external links used in OL items at least once per year.

### Is there a precedent of this approach succeeding elsewhere?

### Which suggestions or requirements should be considered for how feature needs to appear or be implemented?

### Leads

### Related files

### Stakeholders


### Instructions for Contributors

- Please [run these commands](https://github.com/internetarchive/openlibrary/wiki/Git-Cheat-Sheet#working-on-your-branch) to ensure your repository is up to date **before** [creating a new branch](https://github.com/internetarchive/openlibrary/wiki/Git-Cheat-Sheet#making-changes-and-creating-a-pull-request) to work on this issue and **each time after** pushing code to Github, because the pre-commit bot may add commits to your PRs upstream.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.