apertium / apertium/lttoolbox

Option to output '~' as compound separator

Open
#177 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
21
Forks
26
PR merge metrics
No merged PRs in 30d

Description

`apertium-pretransfer` has option `-e treat ~ as compound separator` – I don't know if any other tools have this, but it would be nice if we could implement support for that throughout the pipeline so that we can keep `+` in the sense of `` and `~` in the sense of compounds separate.

### Motivation:
Currently, transfer has no way of knowing if there was an actual space in input or it was just placed there by pretransfer which saw a + and output a space.

If in transfer you want to match a compound followed by something else, you currently have to output the first two parts with no `` and then a `` – but that first blank that you output will be the space that was added by pretransfer, with rules like
```



```
This means that on the one hand we get `luftputebåtenmin` → lt-proc → `luftpute+båten[]min[]` → pretransfer → `luftpute båten[]min[]` → transfer → `luftputebåten min[][]`, but also that it's not really possible to make a general rule that matches, say, both dynamic compounds and number-compounds that should be treated the same way but had no space added by pretransfer (that first `` will then be empty, turning `2.-kvartalet deres` into `2.kvartaletdeira`).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.