DDMAL / DDMAL/Rodan

[Text_alignment / OCR] Syllables not being picked up for MS73

Open
#1,215 3 comments 0 reactions 0 assignees View on GitHub
bug ON HOLD Text Alignment
Dominant language
CSS
Stars
46
Forks
13
PR merge metrics
No merged PRs in 30d

Description

**UPDATE: This might be in part due to a user mistake (here we are again), so please hold!**

I've been starting to run some e2e OMR workflows with MS73 folios and the text part of the process doesn't seem to be working. Normally, the original image is separated into layers, and the text layer gets sent to the `Text_Alignment` job, which uses OCR to roughly find the syllables and then match them with the correct text that we provide. In Neon, the syllables will look like this (this is a Salzinnes folio):

Salzie good syllables example

However, this process doesn't seem to be working for MS73. So far, @kyrieb-ekat got this (enjoy the numbers):
![Kyrie text nuggets](https://github.com/user-attachments/assets/7ed4d408-284f-4c7c-8a9a-6d23b7e4bc05)

And I got no syllables at all:
MS73 054 no syllables

Because the syllable text is directly related to how the neumes are grouped into syllables, these errors result in the syllable groupings being completely wrong, which lengthens the correction time quite a bit.

I ran an e2e OMR workflow with an Einsie folio and the syllables were perfect, so this seems to be an MS73-specific problem. Could it simply be that the training model we've been using for Salzinnes and Einsie doesn't work for MS73? In the `Text_Alignment` job, the training model is built directly into the job, so I don't think this is something that I can change.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.