aws / aws/sagemaker-python-sdk

custom_overrides flag in sdk

Closed
#2,794 0 comments 0 reactions 1 assignee Claimed by @mollyheamazon View on GitHub
component: training type: feature request
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
2d 2h
Merged PRs (30d)
32

Description

Describe the feature you'd like
Add a flag that can be passed to the sagemaker-training-toolkit from an estimator that allows a user to provide: custom_override=dict[list,list] (default can be None)

How would this feature be used? Please describe.
This would enable the sagemaker-training-toolkit to have additional functionality where users could override commands and provide their own custom launch scripts. For instance, rather than having to use MPI, I could use torch.distributed.launch, deepspeed, or my fork of any of the above.

Describe alternatives you've considered
You could embed these into hyperparameters but this would be a poor user experience. You could use environment variables, but those don't transfer to local sessions (previously listed as a bug).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.