dask / dask/distributed

Track cluster growth during P2P operations

Open
#8,675 0 comments 0 reactions 0 assignees View on GitHub
diagnostics enhancement shuffle
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

This task is a precursor to https://github.com/dask/distributed/issues/8673. Before developing the heuristic, we should track if (and by how much) clusters grew during P2P operations and expose this information for successful and failed P2P operations via an event. This will allow us to understand the impact of such a heuristic and what good thresholds might look like.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.