dask / dask/distributed

Investigate UNIX domain sockets

Open
#3,630 27 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

UNIX domain sockets may be able to accelerate intra-node inter-process communications.

In the TCP comm it may be possible to swap out the socket used if the local and peer hostnames are identical (probably made optional with configuration and dependent on OS used)

Some links from perusing the web:

- https://blog.myhro.info/2017/01/how-fast-are-unix-domain-sockets
- https://unix.stackexchange.com/questions/326510/local-unix-socket-rough-idea-of-throughput

cc @jacobtomlinson , this might interest you? (if you had a bunch of free time that is)

Previous conversation in https://github.com/dask/dask/issues/3657#issuecomment-603275248

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.