ipython / ipython/ipyparallel

Hang after map_sync is called in loop for a number of iterations

Open
#373 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.6k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

The following script hangs after about ~180 iterations on my machine
Number of iterations it gets through seems to be dependent on the time elapsed (hence the sleep)
```
import numpy as np
import ipyparallel as ipp

c = ipp.Client()
dv = c[:]
dv.execute("import time")
dv.execute("import numpy as np")

v = c.load_balanced_view()

def fun(state):
time.sleep(0.5)
return np.random.normal()

# Generation loop
for it in range(1000):
inputs = range(12)
#v = c.load_balanced_view()
outputs = np.array(v.map_sync(fun, inputs))
print "Iteration", it
```
Windows 10, Anaconda installation
`ipyparallel 6.2.4 py27_0`

Cluster is started via `ipcluster start -n 4` on powershell
Tried and same problem observed with both python 2.7 and python 3.7
Tried both load balanced and direct views
No error messages and the powershell window for ipcluster becomes unresponsive

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.