dask / dask/distributed

[DEV DOCS] Networking in distributed

Open
#5,414 0 comments 0 reactions 0 assignees View on GitHub
documentation
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

We require a page in distributed docs to outline how networking works

* What kind of servers do we have
* How do they speak to each others, e.g. what is a comm, what is a batchedcomm, what is a stream
* When and why do we pool comms and when is a comm long living
* What happens (or should happen) if a comm breaks (e.g. stream comm broken removes a worker while direct comms are usually retried/handled)
* When do we use what kind of comm?
* What kind of RPC protocol are we using?

This list is exhaustive. This issue can be used to refine what the content should look like

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.