dask / dask/distributed

Intra-host communication

Open
#2,046 3 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

Currently we have two kinds of comms:

1. inproc:// for intra-process communication with queues
2. tcp:// and tls:// for inter-process or inter-node communication with sockets

There is also a possibility in between for inter-process intra-node, that is for processes communicating to each other on the same machine but in different memory spaces.

Do we expect to see performance improvements from handling this? How expensive would this be to implement?

cc @pitrou in case he has general thoughts

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.