dask / dask/distributed

Validation error in `test_stress_scatter_death`

Open
#7,319 0 comments 0 reactions 0 assignees View on GitHub
regression
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

https://github.com/dask/distributed/actions/runs/3480287781/jobs/5819894059

```python
self =
allow_overlap = False

def validate_state(self, allow_overlap: bool = False) -> None:
validate_state(self.tasks, self.workers, self.clients)

if not (set(self.workers) == set(self.stream_comms)):
raise ValueError("Workers not the same in all collections")

assert self.running.issuperset(self.idle.values()), (
self.running,
list(self.idle.values()),
)
task_prefix_counts: defaultdict[str, int] = defaultdict(int)
for w, ws in self.workers.items():
assert isinstance(w, str), (type(w), w)
assert isinstance(ws, WorkerState), (type(ws), ws)
assert ws.address == w
if ws.status != Status.running:
assert ws.address not in self.idle
assert ws.long_running.issubset(ws.processing)
if not ws.processing:
assert not ws.occupancy
if ws.status == Status.running:
assert ws.address in self.idle
assert not ws.needs_what.keys() & ws.has_what
actual_needs_what: defaultdict[TaskState, int] = defaultdict(int)
for ts in ws.processing:
for tss in ts.dependencies:
if tss not in ws.has_what:
actual_needs_what[tss] += 1
> assert actual_needs_what == ws.needs_what
E AssertionError

distributed\scheduler.py:5051: AssertionError
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.