aws-samples / aws-samples/aws-samples-for-ray
Ray Error when running ray.init() on a Jupyter Notebook with an EMR cluster attached
- Dominant language
- Jupyter Notebook
- Stars
- 74
- Forks
- 25
- PR merge metrics
- No merged PRs in 30d
Description
When attempting to initialize Ray on an EMR cluster that bootstraps the init script in this repo, I'm hitting the following error:
My goal is to utilize Ray in a Jupyter notebook that has an EMR cluster attached. I created a small cluster which bootstraps the init script in this repo. I've created a PySpark notebook, where I run
```
import ray
ray.init()
```
This then produces the following error:
```
An error was encountered:
Interpreter died:
[2022-10-13 20:32:04,701 E 30765 30765] core_worker.cc:137: Failed to register worker 01000000ffffffffffffffffffffffffffffffffffffffffffffffff to Raylet. IOError: [RayletClient] Unable to register worker with raylet. No such file or directory
```
Contributor guide
Assessment
This issue has not been assessed yet.