aws / aws/sagemaker-training-toolkit

Extend documentation regarding distributed training for own Docker containers.

Open
#218 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
530
Forks
140
Avg merge
1h 12m
Merged PRs (30d)
2

Description

**What did you find confusing? Please describe.**
I was searching for documentation regarding distributed training with own docker containers. The current documentation explains how to create containers or extend them to be able to use distributed training with the required modules installation guide , but its does not provide information on how to configure the Estimator class or any other launch parameters to start the distributed training as it does for PyTorch or Tensorflow classes.

**Describe how documentation can be improved**
Add text that describe how to launch the distributed training after creating or extending the docker image.
Do it at these sections:
https://docs.aws.amazon.com/sagemaker/latest/dg/data-parallel-use-api.html#data-parallel-use-python-skd-api (here is a typo in the link that you should also fix, skd instead of sdk)
https://docs.aws.amazon.com/sagemaker/latest/dg/data-parallel-use-api.html#data-parallel-bring-your-own-container

Contributor guide

Open the contributing guide

Research direction

Start by reading the two linked sections, data-parallel-use-python-sdk-api and data-parallel-bring-your-own-container, and compare their existing guidance for PyTorch and TensorFlow classes. Done means the own-container workflow explains how to configure the Estimator or launch parameters for distributed training and the `skd` typo is corrected to `sdk`.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, docker, python
Domain
cloud, documentation, machine-learning
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.