mozilla / mozilla/pontoon

Include TM, human, and other-locale translations as references in LLM prompts

Open
#4,400 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

days LLM P3
Dominant language
Python
Stars
1.7k
Forks
611
Avg merge
1d 19h
Merged PRs (30d)
49

Description

The LLM prompt currently gets a single reference: the one machinery translation the user is refining. Since #4388, the backend can already take multiple references as a {source: [text, …]} mapping and render them as an EXISTING SUGGESTIONS (for reference) block.

We should feed the model the other suggestions the translator can already see:

  • Translation memory matches with quality scores. The highest-quality ones are stronger signal than any MT.
  • Human translations of the entity — existing/previous translations for the entity in the target locale (shown in the History panel).
  • Translations from other locales. Useful for disambiguating the English source (gender, plural, formality, polysemy).

Open questions:

  • What TM quality threshold shall we use?
  • Shall we include any rejected suggestions as negative reference?
  • Should we special-handle the user's preferred locales?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the backend LLM prompt construction and the multiple-reference mapping introduced in #4388. Determine how translation-memory matches, human target-locale history, and other-locale translations should enter the existing suggestions block, then resolve the quality threshold, rejected suggestions, and preferred-locale questions before defining the expected prompt output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, localization
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.