aws / aws/amazon-sagemaker-examples

fairseq_sagemaker_distributed_translate_de2en.ipynb failed CI

Open
#2,514 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

Link to the notebook:
https://github.com/aws/amazon-sagemaker-examples/blob/master/advanced_functionality/fairseq_translation/fairseq_sagemaker_distributed_translate_de2en.ipynb

Error:

---------------------------------------------------------------------------
Exception encountered at "In [2]":
---------------------------------------------------------------------------
CalledProcessError Traceback (most recent call last)
in
----> 1 get_ipython().run_cell_magic('sh', '', '\n# First we download fairseq in order to have access to the scripts\ngit clone https://github.com/pytorch/fairseq.git fairseq-git\ncd fairseq-git\n\n# Binarize the dataset:\nTEXT=../data/iwslt14.token

[...]

CalledProcessError: Command 'b'\n# First we download fairseq in order to have access to the scripts\ngit clone https://github.com/pytorch/fairseq.git fairseq-git\ncd fairseq-git\n\n# Binarize the dataset:\nTEXT=../data/iwslt14.tokenized.de-en\npython preprocess.py --source-lang de --target-lang en \\\n --trainpref $TEXT/train --validpref $TEXT/valid --testpref $TEXT/test \\\n --destdir ..data/iwslt14.tokenized.de-en\n'' returned non-zero exit status 2.

Contributor guide

Open the contributing guide

Research direction

Open advanced_functionality/fairseq_translation/fairseq_sagemaker_distributed_translate_de2en.ipynb and inspect cell 2, especially the shell command that clones fairseq and runs preprocess.py. Run the notebook or its CI validation to reproduce the non-zero exit status. Done means the notebook completes this cell and passes CI.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, jupyter-notebook, python, pytorch
Domain
cloud, machine-learning, testing-qa
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.