internetarchive / internetarchive/openlibrary

Scrape enhanced metadata from BHL

Open
#1,902 1 comment 0 reactions 0 assignees View on GitHub
Affects: Data Lead: @mekarpeles metadata Module: Authors Module: Import Priority: 3 Type: Feature Request
Dominant language
Python
Stars
6.7k
Forks
2k
Avg merge
2d 19h
Merged PRs (30d)
138

Description

## Description

The Biodiversity History Library (BHL) is great at coopting OL/IA data & metadata without credit, but in some cases they've provided enhanced metadata, so we should "steal" that back.

As an example for the work [Die nordischen Schizopoden](https://openlibrary.org/works/OL13699252W), they had a more complete name for author [Carl Zimmer](https://openlibrary.org/authors/OL6552791A), as well as birth and death dates, allowing the author to be disambiguated from the more popular modern science writer [Carl Zimmer](https://openlibrary.org/authors/OL394581A/Carl_Zimmer)

Because they intentionally obscure the link to the original, this will require going from BHL to IA to OL, but should result in some quantity (unclear how much) of higher quality metadata.

This is related something [mentioned](https://github.com/internetarchive/openlibrary/issues/845#issuecomment-372203711) by @GerardMeijssen a while ago.

Another possible source would be to mine Wikidata property [BHL creator ID](https://www.wikidata.org/wiki/Property:P4081) with the expectation that they are all OL authors.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.