internetarchive / internetarchive/openlibrary
Create unit test to detect marc unicode encoding issues
Open
Lead: @cdrini
Module: Import
Priority: 3
Type: Bug
- Dominant language
- Python
- Stars
- 6.7k
- Forks
- 2k
- Avg merge
- 2d 19h
- Merged PRs (30d)
- 138
Description
Here is a recent import from IA into OL:
- IA Record: https://archive.org/details/b30530921_0001
- OL Record: https://openlibrary.org/books/OL50976356M/Abreg%C2%A9%E2%99%AD_de_toute_la_medecine_pratique_...
The long-withstanding issue ( #135 ) of mysterious characters like `©♭` appearing in the Open Library record!
The purpose of this issue is to create a unit test of the smallest possible piece that is breaking. Likely, that is the piece that takes in the MARC record. That way this error should never resurface!
### Stakeholders
@hornc
Contributor guide
Assessment
This issue has not been assessed yet.