sillsdev / sillsdev/silnlp

minimal dependency stable extraction branch/container

Open
#118 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

needs to be revisited
Dominant language
Python
Stars
39
Forks
7
Avg merge
1d 9h
Merged PRs (30d)
5

Description

We are hoping to integrate corpora extraction with a service that provides a front end, so that people can send a .zip file containing project files, and receive back a txt file with all the verses in original versification. I think we can do this with what already exists here and in the machine, but a branch with a smaller base of code focused only on core extractions functions and not requiring .NET would be easier to work with. Or, instead of a branch, it might be a Docker container that isn't GPU-based and just does this one thing well. (Additional features like ClearML integration would also be removed for this use case).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are identified. Start by locating the existing corpus-extraction entry point and inventorying its dependencies, especially .NET and ClearML; compare a minimal branch with a non-GPU Docker container. Done means accepting a ZIP of project files and producing a TXT file containing verses in their original versification without those optional dependencies.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python
Domain
data, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.