aws / aws/amazon-sagemaker-examples

pytorch_mnist_elastic_inference.ipynb failed CI

Open
#2,445 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

Link to the notebook:
https://github.com/aws/amazon-sagemaker-examples/blob/master/sagemaker-python-sdk/pytorch_mnist/pytorch_mnist_elastic_inference.ipynb

Error:

---------------------------------------------------------------------------
Exception encountered at "In [7]":
---------------------------------------------------------------------------
UnexpectedStatusException Traceback (most recent call last)
in
----> 1 estimator.fit({'training': inputs})

/opt/conda/lib/python3.6/site-packages/sagemaker/estimator.py in fit(self, inputs, wait, logs, job_name, experiment_config)
670 self.jobs.append(self.latest_training_job)
671 if wait:
--> 672 self.latest_training_job.wait(logs=logs)
673
674 def _compilation_job_name(self):

/opt/conda/lib/python3.6/site-packages/sagemaker/estimator.py in wait(self, logs)
1601 # If logs are requested, call logs_for_jobs.
1602 if logs != "None":
-> 1603 self.sagemaker_session.logs_for_job(self.job_name, wait=True, log_type=logs)

[...]

cmd, _errors.ExecuteUserScriptError, capture_error=captur

Contributor guide

Open the contributing guide

Research direction

Start by opening sagemaker-python-sdk/pytorch_mnist/pytorch_mnist_elastic_inference.ipynb and reproducing the failure at In [7], where estimator.fit({'training': inputs}) raises UnexpectedStatusException. Trace the reported training-job error and verify that the notebook completes successfully in CI; the payload does not identify a specific test or replacement configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, jupyter-notebook, pytorch
Domain
cloud, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.