internetarchive / internetarchive/openlibrary-bots
BWBImportBot Pipeline Epic
Open
- Dominant language
- Python
- Stars
- 81
- Forks
- 67
- PR merge metrics
- No merged PRs in 30d
Description
Some ideas we discussed:
1. Using sqlite instead of books.jsonl to append every month's results in batches
2. Replace import.log also w/ sqlite
3. Possibly explore gnu parallel
cc: @bharatkalluri
Contributor guide
Assessment
This issue has not been assessed yet.