Easy way to restrict task and all dependencies to certain workers with dask.compute()
Open
- Dominant language
- Python
- Stars
- 1.7k
- Forks
- 778
- Avg merge
- 2h 50m
- Merged PRs (30d)
- 3
Description
Hi there,
currently dask.compute(task, workers="worker1") will force "task" to run on "worker1" but not its dependencies. Is there an easy way to enforce this for the dependencies as well?
I guess there should be a hacky solution using task.dask.dependencies or task.dask.layers? Those return the names of the dependencies. If one can get the corresponding objects from those strings you could feed those into 'workers=(dependencies: "worker1")'.
Thanks,
Chris
Contributor guide
Assessment
This issue has not been assessed yet.