aws-samples / aws-samples/aws-samples-for-ray

Ray Error when running ray.init() on a Jupyter Notebook with an EMR cluster attached

Open
#5 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
74
Forks
25
PR merge metrics
No merged PRs in 30d

Description

When attempting to initialize Ray on an EMR cluster that bootstraps the init script in this repo, I'm hitting the following error:
My goal is to utilize Ray in a Jupyter notebook that has an EMR cluster attached. I created a small cluster which bootstraps the init script in this repo. I've created a PySpark notebook, where I run

```
import ray
ray.init()
```

This then produces the following error:

```
An error was encountered:
Interpreter died:

[2022-10-13 20:32:04,701 E 30765 30765] core_worker.cc:137: Failed to register worker 01000000ffffffffffffffffffffffffffffffffffffffffffffffff to Raylet. IOError: [RayletClient] Unable to register worker with raylet. No such file or directory
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.