dask / dask/distributed

Simplify state management in P2P's `ShuffleSchedulerPlugin`

Open
#8,018 0 comments 0 reactions 1 assignee Claimed by @wence- View on GitHub
hygiene shuffle
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

As mentioned in https://github.com/dask/distributed/pull/7970#discussion_r1266814524, keeping the internal state of the plugin is currently done manually. This is prone to errors, increases the cognitive load during maintenance, and makes the code generally harder to understand. We should refactor it so that it's easier to understand and maintain invariants.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.