aws / aws/amazon-sagemaker-examples
fairseq_sagemaker_translate_de2en.ipynb failed CI
- Dominant language
- Jupyter Notebook
- Stars
- 11k
- Forks
- 7k
- Avg merge
- 8h 29m
- Merged PRs (30d)
- 8
Description
Link to the notebook:
https://github.com/aws/amazon-sagemaker-examples/blob/master/advanced_functionality/fairseq_translation/fairseq_sagemaker_translate_de2en.ipynb
Error:
---------------------------------------------------------------------------
Exception encountered at "In [2]":
---------------------------------------------------------------------------
CalledProcessError Traceback (most recent call last)
in
----> 1 get_ipython().run_cell_magic('sh', '', '\n# First we download fairseq in order to have access to the scripts\ngit clone https://github.com/pytorch/fairseq.git fairseq-git\ncd fairseq-git\n\n# Binarize the dataset:\nTEXT=../data/iwslt14.token
[...]
CalledProcessError: Command 'b'\n# First we download fairseq in order to have access to the scripts\ngit clone https://github.com/pytorch/fairseq.git fairseq-git\ncd fairseq-git\n\n# Binarize the dataset:\nTEXT=../data/iwslt14.tokenized.de-en\npython preprocess.py --source-lang de --target-lang en \\\n --trainpref $TEXT/train --validpref $TEXT/valid --testpref $TEXT/test \\\n --destdir ..data/iwslt14.tokenized.de-en\n'' returned non-zero exit status 2.
Contributor guide
Research direction
Start with advanced_functionality/fairseq_translation/fairseq_sagemaker_translate_de2en.ipynb and inspect the failing In [2] shell cell, especially the reported fairseq preprocessing command. Reproduce the CI failure and identify why that command exits with status 2; done means the notebook completes successfully in CI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, git, jupyter-notebook, python
- Domain
- ci-cd, machine-learning, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100