aws / aws/sagemaker-tensorflow-extensions

s3PipeDataset example

Open
#125 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
54
Forks
39
PR merge metrics
No merged PRs in 30d

Description

**What did you find confusing? Please describe.**
I have been trying to start a Sagemaker job with s3pipedataset using TensorFlow or PyTorch but so far I have not been successful. Also, I think pipe mode doesn't work locally.

Is there some documentation or a notebook for end-to-end training using s3pipedataset?

Or at least provide some datasets already stored in PipeDatasetFormat that can be directly loaded into a TensorFlow or PyTorch model.

If possible can you guys also share some Image Dataset for the Computer Vision example?

A clear and concise description of what you found confusing. Ex. I tried to [...] but I didn't understand how to [...]

**Describe how documentation can be improved**
A clear and concise description of where documentation was lacking and how it can be improved.

**Additional context**
Add any other context or screenshots about the documentation request here.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Review the existing SageMaker TensorFlow extensions documentation and examples first, then narrow the request to one end-to-end s3pipedataset workflow; completion would require a documented, reproducible TensorFlow or PyTorch example with a stated dataset and expected training result.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch, tensorflow
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.