internetarchive / internetarchive/openlibrary

Bot account request: import Portuguese books from Biblioteca Nacional de Portugal (CC0)

Open
#13,222 5 comments 0 reactions 0 assignees View on GitHub
Affects: Data Lead: @mekarpeles Module: Import Needs: Response Needs: Staff Decision Priority: 3
Dominant language
Python
Stars
6.7k
Forks
2k
Avg merge
2d 14h
Merged PRs (30d)
126

Description

Hi @mekarpeles,

I'd like to request bot privileges (API usergroup access) for a new
account to import Portuguese-language books into Open Library.

**Bot account:** [pagyn_bot] (https://openlibrary.org/people/pagyn_bot)

**Source:** Biblioteca Nacional de Portugal (BNP) open data —
"Bibliografia Nacional Portuguesa" dataset, covering monographs
published in Portugal since 2002, ISBN included. License: CC0
(public domain). Source: https://opendata.bnportugal.gov.pt/downloads.htm

**Why:** Open Library's coverage of Portuguese-language books is
thin. This is a national library catalog, freely licensed, that
directly addresses recent/missing books that users are searching for.

**Method:** I'll transform the CC0 dataset into the Open Library
import schema (title, authors, publishers, publish_date,
source_records, isbn, languages: por) and submit via the batch
import endpoint (/import/batch/new), following the process described
in the Writing Bots docs. Source files and script will be committed
to openlibrary-bots per the guidelines, and I will not run bulk
modifications until the script has been reviewed.

Happy to start with a small sample batch first for review before
any larger import. Thanks!

Contributor guide

Open the contributing guide

Research direction

Start with the Writing Bots documentation and the openlibrary-bots guidelines, then review the /import/batch/new endpoint and the BNP dataset linked in the issue. Done means the source files and transformation script are committed, a small sample batch is submitted for review, and bulk modifications wait for approval.

Written by the indexing model from the issue text.

Assessment

Domain
api, data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.