DDMAL / DDMAL/UMIL

Automate instrument import from Wikidata and replace our initial CSV-based data importing method

Open
#333 7 comments 0 reactions 1 assignee Claimed by @kunfang98927 View on GitHub
Dominant language
Python
Stars
4
Forks
2
PR merge metrics
No merged PRs in 30d

Description

In the current implementation, when importing instruments, we read from a CSV file that lists the instrument entries we have collected. The CSV contains three columns: `instrument`, `instrumentLabel`, and `image`. In the `import_instruments` command, we iterate through all entries in the CSV and import both the instruments and their labels into the UMIL database. Additionally, the `download_imgs` command handles the download and storage of instrument images, including both the original images and resized thumbnails.

One of the main advantages of this CSV-based approach is that it allows us to manually filter and curate the data. This ensures that only the desired instruments are imported into the database, preventing irrelevant entries (e.g., "transposing instrument," "other instrument," etc.) from being included. It also guarantees that the data is clean and well-organized, as the CSV can be carefully reviewed and edited before the import process.

However, as we move forward, we aim to upgrade our data import method. Rather than relying on a manually curated CSV file, we plan to implement an automated process to collect and clean instrument data directly from Wikidata. This will allow for more efficient data collection, reduce manual effort, and ensure that our database is continuously updated with accurate and up-to-date information.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.