aws / aws/sagemaker-python-sdk

@ remote support for multi-instance training job

Đã đóng
#4,125 1 bình luận 0 reaction 1 người được giao Được @nargokul nhận Xem trên GitHub
component: training remote-function type: feature request
Ngôn ngữ chính
Python
Star
2.3k
Fork
1.3k
Merge trung bình
1 ngày 22 giờ
Pull request đã merge (30 ngày)
35

Mô tả

**Describe the feature you'd like**
Need the ability to use @ remote to train on a multi-instance node for distributed training.

**How would this feature be used? Please describe.**
Distributed training packages like h2o can be used with @ remote. Currently @ remote restrict the instance count for training job to "One" instance

**Describe alternatives you've considered**
Use sagemaker.estimator.Estimator to configure distributed training job. This requires duplication of code when switching between local mode vs Instance based training.

**Additional context**
We are in the process of switching from SageMaker notebook instance to SageMaker Studio. SageMaker studio does not support local mode at this time. So, in order to test with local mode we are using @ remote. However, to train on large datasets we use distributed training. In Sagemaker Notebook Instance env, sagemaker.estimator.Estimator easily allowed us to switch between local and multi-instance based training. However, not having a SDK function for a comparable local/distributed training option in studio is causing a lot of rework of templates. Enhancing @ remote to train on multi-instance would mitigate the concern.

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.