esa / esa/pygmo2

allowing nested parallelism in python multiprocessing

Open
#24 6 comments 0 reactions 0 assignees View on GitHub
bug enhancement
Dominant language
C++
Stars
536
Forks
74
PR merge metrics
No merged PRs in 30d

Description

Right now the use of an archipelago with, for example, a bfe based algo will not work if python multiprocessing islands are used with a multiprocessing bfe. The reason is that daemonic processes do not allow nested parallelism.
```python
AssertionError: daemonic processes are not allowed to have children
```

A possible solution would be the use of non daemonic processes in the python mp module.

See related discussions:
https://stackoverflow.com/questions/28491558/launching-nested-processes-in-multiprocessing
https://stackoverflow.com/questions/6974695/python-process-pool-non-daemonic

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.