dask / dask/distributed

Broken multiprocessing queues in tests?

Open
#6,001 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

I'm seeing this in a few of our CI runs. It seems to correlate with workers within Nannies not coming up.

```python-traceback
Traceback (most recent call last):
File "", line 1, in
File "/usr/share/miniconda3/envs/dask-distributed/lib/python3.9/multiprocessing/spawn.py", line 116, in spawn_main
exitcode = _main(fd, parent_sentinel)
File "/usr/share/miniconda3/envs/dask-distributed/lib/python3.9/multiprocessing/spawn.py", line 126, in _main
self = reduction.pickle.load(from_parent)
File "/usr/share/miniconda3/envs/dask-distributed/lib/python3.9/multiprocessing/synchronize.py", line 110, in __setstate__
self._semlock = _multiprocessing.SemLock._rebuild(*state)
FileNotFoundError: [Errno 2] No such file or directory
```

Web searches on the last two lines point to CPython bug reports like https://bugs.python.org/issue28965

This is a bit lower level than I'm comfortable/knowledgable with. I'm curious if other folks have any impressions on what might have started to cause this. cc @graingert

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.