argosopentech / argosopentech/argos-train
Possible issue with validation set creation?
- Dominant language
- Python
- Stars
- 158
- Forks
- 29
- PR merge metrics
- No merged PRs in 30d
Description
I was giving a good read to https://github.com/argosopentech/argos-train/blob/master/argostrain/data.py#L21 and noticed that the input is not shuffled.
Shouldn't the the input should be shuffled to have a better distribution? For example, if your first source is a wiktionary dataset, the program would be validating the dataset only against single word translations.
Contributor guide
No contributing guide indexed for this repository
Research direction
Read argostrain/data.py around line 21 and trace how the validation set is created from the input data. Run the repository's existing tests or a small reproduction with an ordered dataset; done means validation data is distributed rather than remaining grouped by the input's original ordering.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100