ipython / ipython/ipyparallel

Hang after map_sync is called in loop for a number of iterations

Aberta
#373 7 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Jupyter Notebook
Estrelas
2.6k
Forks
1k
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição

The following script hangs after about ~180 iterations on my machine
Number of iterations it gets through seems to be dependent on the time elapsed (hence the sleep)
```
import numpy as np
import ipyparallel as ipp

c = ipp.Client()
dv = c[:]
dv.execute("import time")
dv.execute("import numpy as np")

v = c.load_balanced_view()

def fun(state):
time.sleep(0.5)
return np.random.normal()

# Generation loop
for it in range(1000):
inputs = range(12)
#v = c.load_balanced_view()
outputs = np.array(v.map_sync(fun, inputs))
print "Iteration", it
```
Windows 10, Anaconda installation
`ipyparallel 6.2.4 py27_0`

Cluster is started via `ipcluster start -n 4` on powershell
Tried and same problem observed with both python 2.7 and python 3.7
Tried both load balanced and direct views
No error messages and the powershell window for ipcluster becomes unresponsive

Guia de contribuição

Abrir o guia de contribuição

Direção de pesquisa

Start by running the issue's Python reproducer with `ipcluster start -n 4` on Windows, comparing the load-balanced and direct-view cases. Trace where `map_sync` stops responding after repeated iterations; done means the loop completes without hanging and the fix is verified for both reported Python versions.

Escrita pelo modelo de indexação a partir do texto da issue.

Avaliação

Stack de tecnologia
jupyter, python
Domínio
distributed-systems
Tipo de issue
Bug
Dificuldade
4/5
Tempo estimado
3-5 dias
Status de atividade
Estagnada
Clareza
Razoavelmente clara
Facilidade para iniciantes
35/100

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.