argosopentech / argosopentech/argos-train
Inclusion of tldr-pages corpus from OPUS in data-index.json
- Dominant language
- Python
- Stars
- 158
- Forks
- 29
- PR merge metrics
- No merged PRs in 30d
Description
Over at tldr-pages, we developed a project to adapt the contents of [tldr](https://github.com/tldr-pages/tldr) into a corpus for OPUS.
Would it be feasible to include it in `argos-train/data-index.json`?
I hoped that it'd be good for including more context around technical/command-line terminology in the dataset.
OPUS corpus: https://opus.nlpl.eu/tldr-pages.php
## Related
* Follow up to this discussion: https://github.com/LibreTranslate/LibreTranslate/pull/268#issuecomment-1166595159
Contributor guide
No contributing guide indexed for this repository
Research direction
Inspect argos-train/data-index.json and the linked OPUS tldr-pages corpus first. Confirm the metadata and placement expected by the index, then add the corpus entry and verify that the data index remains valid and the corpus is available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100