aws / aws/amazon-sagemaker-examples
framework-container.ipynb failed CI
- Dominant language
- Jupyter Notebook
- Stars
- 11k
- Forks
- 7k
- Avg merge
- 8h 29m
- Merged PRs (30d)
- 8
Description
Link to the notebook:
https://github.com/aws/amazon-sagemaker-examples/blob/master/advanced_functionality/custom-training-containers/framework-container/notebook/framework-container.ipynb
Error:
---------------------------------------------------------------------------
Exception encountered at "In [12]":
---------------------------------------------------------------------------
Exception Traceback (most recent call last)
in
23 val_config = sagemaker.session.s3_input('s3://{0}/{1}/val/'.format(bucket, prefix), content_type='text/csv')
24
---> 25 est.fit({'train': train_config, 'validation': val_config })
/opt/conda/lib/python3.7/site-packages/sagemaker/estimator.py in fit(self, inputs, wait, logs, job_name, experiment_config)
667 self._prepare_for_training(job_name=job_name)
668
--> 669 self.latest_training_job = _TrainingJob.start_new(self, inputs, experiment_config)
670 self.jobs.append(self.latest_training_job)
671
[...]
Exception: Failed to run docker,images,-q,521695447989.dkr.ecr.us-west-2.amazonaws.com/sagemaker-training-containers/framework-container:latest
Contributor guide
Research direction
Open advanced_functionality/custom-training-containers/framework-container/notebook/framework-container.ipynb from the issue link and inspect cell In [12], especially the est.fit call. Reproduce the failure in the CI environment while checking the Docker image command and ECR image reference shown in the traceback. Done means the notebook's training step runs successfully in CI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, docker, jupyter-notebook, python
- Domain
- ci-cd, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100