aws / aws/amazon-sagemaker-examples

managed_spot_training_object_detection.ipynd fatal error in loading data

Open
#1,612 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

Hi. I am trying to walk through the 10-minute tutorial on Optimizing and Scaling Machine Learning Training. When I try to run my copy of the managed-spot_training_object_detection.ipynd notebook, following the tutorial steps exactly, I get a fatal error at Download and Prepare Data.
--2020-10-12 23:50:32-- http://host.robots.ox.ac.uk/pascal/VOC/voc2012/VOCtrainval_11-May-2012.tar
Resolving host.robots.ox.ac.uk (host.robots.ox.ac.uk)... 129.67.94.152
Connecting to host.robots.ox.ac.uk (host.robots.ox.ac.uk)|129.67.94.152|:80... failed: No route to host.
--2020-10-12 23:50:35-- http://host.robots.ox.ac.uk/pascal/VOC/voc2007/VOCtrainval_06-Nov-2007.tar
Resolving host.robots.ox.ac.uk (host.robots.ox.ac.uk)... 129.67.94.152
Connecting to host.robots.ox.ac.uk (host.robots.ox.ac.uk)|129.67.94.152|:80... failed: No route to host.
--2020-10-12 23:50:38-- http://host.robots.ox.ac.uk/pascal/VOC/voc2007/VOCtest_06-Nov-2007.tar
Resolving host.robots.ox.ac.uk (host.robots.ox.ac.uk)... 129.67.94.152
Connecting to host.robots.ox.ac.uk (host.robots.ox.ac.uk)|129.67.94.152|:80... failed: No route to host.
tar: /tmp/VOCtrainval_11-May-2012.tar: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
tar: /tmp/VOCtrainval_06-Nov-2007.tar: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
tar: /tmp/VOCtest_06-Nov-2007.tar: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
Traceback (most recent call last):
File "tools/prepare_dataset.py", line 95, in
db = load_pascal(args.set, args.year, args.root_path, args.shuffle)
File "tools/prepare_dataset.py", line 63, in load_pascal
imdbs.append(PascalVoc(s, y, devkit_path, shuffle, is_train=True))
File "/home/ec2-user/SageMaker/managed_spot_training_object_detection_2020-10-12/tools/pascal_voc.py", line 59, in __init__
self.image_set_index = self._load_image_set_index(shuffle)
File "/home/ec2-user/SageMaker/managed_spot_training_object_detection_2020-10-12/tools/pascal_voc.py", line 91, in _load_image_set_index
assert os.path.exists(image_set_index_file), 'Path does not exist: {}'.format(image_set_index_file)
AssertionError: Path does not exist: /home/ec2-user/SageMaker/managed_spot_training_object_detection_2020-10-12/tools/../VOCdevkit/VOC2007/ImageSets/Main/trainval.txt
Traceback (most recent call last):
File "tools/prepare_dataset.py", line 95, in
db = load_pascal(args.set, args.year, args.root_path, args.shuffle)
File "tools/prepare_dataset.py", line 63, in load_pascal
imdbs.append(PascalVoc(s, y, devkit_path, shuffle, is_train=True))
File "/home/ec2-user/SageMaker/managed_spot_training_object_detection_2020-10-12/tools/pascal_voc.py", line 59, in __init__
self.image_set_index = self._load_image_set_index(shuffle)
File "/home/ec2-user/SageMaker/managed_spot_training_object_detection_2020-10-12/tools/pascal_voc.py", line 91, in _load_image_set_index
assert os.path.exists(image_set_index_file), 'Path does not exist: {}'.format(image_set_index_file)
AssertionError: Path does not exist: /home/ec2-user/SageMaker/managed_spot_training_object_detection_2020-10-12/tools/../VOCdevkit/VOC2007/ImageSets/Main/test.txt

I will go look at the data repository website to see if there is an update to the files, but in the meantime please check the notebook and correct the data download so us users can make progress.

Thank yoiu.

Contributor guide

Open the contributing guide

Research direction

Start with the managed_spot_training_object_detection notebook's “Download and Prepare Data” step, then inspect tools/prepare_dataset.py and tools/pascal_voc.py alongside the reported download URLs. Update the data source so the VOC files are retrieved successfully, and rerun the preparation step until the referenced VOCdevkit image-set paths exist without errors.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, jupyter-notebook, python
Domain
data-engineering, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.