Revise memory limits on the default LocalCluster
Open
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 778
- Avg merge
- 2h 50m
- Merged PRs (30d)
- 3
Description
A `Client()` will create processes with hard memory limits 1/N of the system RAM; they will be killed by the nanny at 95%. It actually may be fine on a local machine to increase beyond this, and in any case, a new process will appear and all the work will be redistributed on the same node anyway.
This is open for discussion.
Contributor guide
Assessment
This issue has not been assessed yet.