argosopentech / argosopentech/argos-train

Possible issue with validation set creation?

Open
#32 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
158
Forks
29
PR merge metrics
No merged PRs in 30d

Description

I was giving a good read to https://github.com/argosopentech/argos-train/blob/master/argostrain/data.py#L21 and noticed that the input is not shuffled.

Shouldn't the the input should be shuffled to have a better distribution? For example, if your first source is a wiktionary dataset, the program would be validating the dataset only against single word translations.

Contributor guide

No contributing guide indexed for this repository

Research direction

Read argostrain/data.py around line 21 and trace how the validation set is created from the input data. Run the repository's existing tests or a small reproduction with an ordered dataset; done means validation data is distributed rather than remaining grouped by the input's original ordering.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.