aws / aws/sagemaker-spark

Sagemaker - Java Errors while running notebook in a VPC

Open
#134 3 comments 3 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
301
Forks
129
PR merge metrics
No merged PRs in 30d

Description

### System Information
- **Spark or PySpark**: Pyspark

### Describe the problem
Sagemaker throws the exception as below while running notebook in a VPC
Java gateway process exited before sending its port number.

The same spark code works fine in the notebook running without VPC using conda python3 kernel.

Contributor guide

Open the contributing guide

Research direction

No repository file or test is named. Start by reproducing the PySpark notebook with and without a VPC using the conda python3 kernel, then compare the full Java gateway failure and SageMaker configuration. Done means the notebook runs successfully in the VPC without the reported exception.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.