sillsdev / sillsdev/silnlp

Explore alternative method for spinning off silnlp jobs on ClearML

Open
#378 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

clowder needs to be revisited
Dominant language
Python
Stars
39
Forks
7
Avg merge
1d 9h
Merged PRs (30d)
5

Description

It would be cleaner to spin off ClearML jobs directly rather than running scripts from clowder. The drawback would be that we would need to be careful to maintain consistency between silnlp scripts and clowder runs.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Begin by comparing the current silnlp scripts and Clowder runs with the proposed direct ClearML jobs. Identify how consistency between those execution paths is maintained today and define the boundaries of the alternative approach. Done should be a documented, agreed design that explains how the two paths remain consistent.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.