dask / dask/distributed

What is the significance of the lock files when different workers are started with different local directories?

Open
#3,316 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

I'm creating different runtime directories for each worker. And I noticed that each worker creates a `global.lock` and `purge.lock` files.

Are these files meant to be coordinated between all invocations of `dask-worker` workers?

Or are they only used for a single `dask-worker` where it has multiple processes/threads using the same directory.

Can there be a problem with multiple invocations of `dask-worker` are using different local directories or the same local directory?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.