aws / aws/sagemaker-python-sdk
Support local source for sagemaker.core.shapes.ProcessingInput
- Lenguaje dominante
- Python
- Estrellas
- 2.3k
- Forks
- 1.3k
- Merge medio
- 1 d 22 h
- PR fusionados (30 d)
- 35
Descripción
**Describe the feature you'd like**
Allow for `sagemaker.core.shapes.ProcessingInput` to accept local file path as input, for automatic uploading of input files to S3.
**How would this feature be used? Please describe.**
When migrating from sagemaker v2 to v3, the `sagemaker.processing.ProcessingInput` used in `sagemaker.workflow.steps.ProcessingStep.inputs()` is no longer applicable, replaced by `sagemaker.core.shapes.ProcessingInput` used in `sagemaker.core.processing.ScriptProcessor.run()`. `sagemaker.core.shapes.ProcessingInput` accepts only S3 path, which makes it more convoluted for the training pipeline process as the files involved in the pipeline have to be uploaded separately before the creation of the pipeline, instead of how it was done in v2's `sagemaker.processing.ProcessingInput` which uploads it while the pipeline is being built.
Guía de contribución
Línea de trabajo
Comienza rastreando sagemaker.core.shapes.ProcessingInput y sagemaker.core.processing.ScriptProcessor.run(), y luego compara su comportamiento con el de sagemaker.processing.ProcessingInput de v2 descrito en el issue. Determina cómo se debe cargar una ruta de archivo local mientras se construye el pipeline y verifica que las entradas de S3 existentes sigan funcionando.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- aws, python
- Área
- cloud, machine-learning
- Tipo de issue
- Nueva funcionalidad
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Estado de actividad
- Tranquilo
- Claridad
- Bastante claro
- Aptitud para principiantes
- 45/100