dask / dask/distributed

Document where local files and spilled data are stored

Open
#7,293 0 comments 0 reactions 0 assignees View on GitHub
documentation
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

In https://dask.discourse.group/t/where-does-dask-spill-to-disk/1296/2 someone asked where workers spill their results. After some quick searching through the docs, I realized I don't think this is well documented (or maybe I just missed it). This also comes into play when thinking about uploading local files (e.g. `UploadDirectory` plugin). I think it'd be reasonable for us to have a brief documentation section around `local_directory` and how it can be configured.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.