dask / dask/distributed

test_rebalance_raises_missing_data3[True] flaky on my dev box

Open
#6,023 0 comments 0 reactions 0 assignees View on GitHub
flaky test
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

test_scheduler::test_rebalance_raises_missing_data3[True] is highly flaky (~65% failure rate) on my hi-powered dev box. It seems to be stable on CI, likely due to the much slower CPU on the CI boxes.

```python
futures = await c.scatter(range(100), workers=[a.address])

if explicit:
keys = [f.key for f in futures]
del futures
out = await s.rebalance(keys=keys)
assert out["status"] == "partial-fail"
assert 1 <= len(out["keys"]) <= 100
```

There is clearly a race condition going on between the client->scheduler comms and the scheduler->worker comms.

@fjetter I recall you once showed me a way to block Scheduler.rpc on an event?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.