dask / dask/distributed

Easy way to restrict task and all dependencies to certain workers with dask.compute()

Open
#3,592 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

Hi there,

currently dask.compute(task, workers="worker1") will force "task" to run on "worker1" but not its dependencies. Is there an easy way to enforce this for the dependencies as well?

I guess there should be a hacky solution using task.dask.dependencies or task.dask.layers? Those return the names of the dependencies. If one can get the corresponding objects from those strings you could feed those into 'workers=(dependencies: "worker1")'.

Thanks,
Chris

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.