aws / aws/amazon-sagemaker-examples
fairseq_sagemaker_distributed_translate_de2en.ipynb failed CI
- Dominant language
- Jupyter Notebook
- Stars
- 11k
- Forks
- 7k
- Avg merge
- 8h 29m
- Merged PRs (30d)
- 8
Description
Link to the notebook:
https://github.com/aws/amazon-sagemaker-examples/blob/master/advanced_functionality/fairseq_translation/fairseq_sagemaker_distributed_translate_de2en.ipynb
Error:
---------------------------------------------------------------------------
Exception encountered at "In [2]":
---------------------------------------------------------------------------
CalledProcessError Traceback (most recent call last)
in
----> 1 get_ipython().run_cell_magic('sh', '', '\n# First we download fairseq in order to have access to the scripts\ngit clone https://github.com/pytorch/fairseq.git fairseq-git\ncd fairseq-git\n\n# Binarize the dataset:\nTEXT=../data/iwslt14.token
[...]
CalledProcessError: Command 'b'\n# First we download fairseq in order to have access to the scripts\ngit clone https://github.com/pytorch/fairseq.git fairseq-git\ncd fairseq-git\n\n# Binarize the dataset:\nTEXT=../data/iwslt14.tokenized.de-en\npython preprocess.py --source-lang de --target-lang en \\\n --trainpref $TEXT/train --validpref $TEXT/valid --testpref $TEXT/test \\\n --destdir ..data/iwslt14.tokenized.de-en\n'' returned non-zero exit status 2.
Contributor guide
Research direction
Open advanced_functionality/fairseq_translation/fairseq_sagemaker_distributed_translate_de2en.ipynb and inspect cell 2, especially the shell command that clones fairseq and runs preprocess.py. Run the notebook or its CI validation to reproduce the non-zero exit status. Done means the notebook completes this cell and passes CI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, jupyter-notebook, python, pytorch
- Domain
- cloud, machine-learning, testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100