aws / aws/sagemaker-python-sdk

Doesn't allow us to specify a directory path as an argument to submit_py_files parameter in spark_processor.run method

未关闭
#2,447 1 条评论 1 个 reaction 已指派 1 人 已被 @nargokul 认领 在 GitHub 查看
component: processing contributions welcome type: bug
主要语言
Python
星标
2.3k
派生
1.3k
平均合并
1 天 22 小时
30 天内合并 PR
35

描述

As per https://github.com/aws/sagemaker-python-sdk/blob/master/src/sagemaker/spark/processing.py#L76 the comments local directory paths should be allowed.

However, when we try to pass a directory path we get the following error:

`submit_deps path file:///home/ec2-user/SageMaker/code/ is not a valid local file. Please specify a list of one or more S3 URIs, local file paths, and/or local directory paths`

Most likely this spawns from the check below:

https://github.com/aws/sagemaker-python-sdk/blob/12a69180e2e88739f4fd28ed36fe88da40139f54/src/sagemaker/spark/processing.py#L441

`exists` check instead of isfile here might help resolve the issue.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。