aws / aws/sagemaker-python-sdk

Support local source for sagemaker.core.shapes.ProcessingInput

Open
#5,672 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

**Describe the feature you'd like**
Allow for `sagemaker.core.shapes.ProcessingInput` to accept local file path as input, for automatic uploading of input files to S3.

**How would this feature be used? Please describe.**
When migrating from sagemaker v2 to v3, the `sagemaker.processing.ProcessingInput` used in `sagemaker.workflow.steps.ProcessingStep.inputs()` is no longer applicable, replaced by `sagemaker.core.shapes.ProcessingInput` used in `sagemaker.core.processing.ScriptProcessor.run()`. `sagemaker.core.shapes.ProcessingInput` accepts only S3 path, which makes it more convoluted for the training pipeline process as the files involved in the pipeline have to be uploaded separately before the creation of the pipeline, instead of how it was done in v2's `sagemaker.processing.ProcessingInput` which uploads it while the pipeline is being built.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.