sillsdev / sillsdev/silnlp

Custom marker mismatch between source project and target project when translating

Open
#602 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
39
Forks
7
Avg merge
1d 9h
Merged PRs (30d)
5

Description

There are cases where the source project defines custom markers that are not defined in the target project. Copying these markers into the draft text may cause issues with the target project if the custom marker is not defined in the target project. In some cases, the custom marker is not correctly recognized during parsing, and the draft text includes the opening marker but does not include the marker content nor closing marker.

As an example, the BHNSB translation defines an "extended footnote" marker ("\ef", "\ef*"). When books from the BHNSB are translated into a target language, the opening "\ef" marker is retrained in the draft that is created, while the content of the marker and the closing marker is removed. The BHNSB text for Ruth 1:22 has an extended footnote:

\v 17 Pale utakapofia hapo nitakufa nami, \q1 na papo hapo nitazikwa; \q1 Mwenyezi-Mungu anipe adhabu kali kama nikitenganishwa nawe \q1 isipokuwa tu kwa kifo.”\ef f \fr 1:16-17 \ft Aya hizi zimewekwa katika muundo wa utenzi au shairi. Muhimu katika utenzi huu ni tamko la Ruthu la kujiweka mmoja na jumuiya ya Waisraeli.\ef*

which gets translated as follows in the draft verse:

\v 17 Palu' pawaalu'a waa ngapaniwaa, no sikilwa. Nnu'ngu' anipei ukumu ngali' mana naabu'kana na wenga, ila kwa kiwo bai." \q1 \q1 \q1 \ef

(Note the opening marker ("\ef") with no marker content and closing marker.)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Reproduce the BHNSB-to-target translation using the Ruth 1:22 example, then trace custom-marker parsing and draft generation; done means undefined target markers no longer leave an opening marker while dropping the marker content and closing marker.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
localization
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.