dask / dask/distributed

Ability to cancel the chain of dependent tasks from within some task

Open
#1,790 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

Let's assume there're tasks A, B, and C. And B and C depend on A. And all tasks depend on some parameters:
```python
a: Delayed = A(params)
b: Delayed = B(a, params)
c: Delayed = C(a, params)
```

Any task may decide, given a particular input, that it doesn't want to continue computation. So, if A decides so, B and C won't even be started.

At this point, I think I can implement it by simply throwing an exception from the task that doesn't want to continue computation, and check for the exception when I check the future's result. The issue is that workers output all such exceptions.

Is it possible to implement such functionality in a manner that doesn't flood workers' output?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.