aws / aws/sagemaker-python-sdk

Possibility to add source_directory to Sagemaker.processing.ScriptProcessor

Open
#2,117 12 comments 18 reactions 0 assignees View on GitHub
component: processing contributions welcome type: feature request
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

**Describe the feature you'd like**
Currently there is no option to add source_dir to `Sagemaker.processing.ScriptProcessor`, which makes it difficult to have modular code.

**How would this feature be used? Please describe.**
This will help using ScriptProcessor to be used for running complex processing logic. Especially where the project has different modules and each module perform different processing step.

**Describe alternatives you've considered**
running it directly on docker ?

Contributor guide

Open the contributing guide

Research direction

Start by locating the Sagemaker.processing.ScriptProcessor entry point and reviewing how it currently packages or exposes processing scripts. Determine the expected source_directory behavior for modular processing code, then add coverage for that behavior and verify that ScriptProcessor can run code organized across modules.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.