dask/distributed

View on GitHub

A distributed task scheduler for Dask

Stars: 1.7k
Forks: 778
Open beginner issues: 0
Indexed issues: 1.2k
Avg merge: 2h 50m
Merged PRs (30d): 3

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Aug 26, 2026
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted good first issue

Open All

1248 open issues indexed

`mindeps` CI environment includes `numpy` and `pandas` Open

bug tests

dask/distributed#8640 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`Scheduler`/`Worker` threads hang when calling `sys.exit()` Open

needs triage

dask/distributed#8644 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Annotation of positional arguments *args in dask.distributed.Client.submit API (2024.1.1) Open

needs triage

dask/distributed#8645 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Worker profile limited to a short timespan Open

bug

dask/distributed#8653 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Ability to specify cost value for computations Open

enhancement

dask/distributed#8654 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[P2P] `merge_unpack` does not reschedule on `ShuffleClosedError` Open

bug shuffle

dask/distributed#8660 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Client.map() keys as a list breaks Dask queue system Open

needs triage

dask/distributed#8671 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Restart P2P if cluster significantly grew in size Open

adaptive enhancement performance shuffle

dask/distributed#8673 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Restart P2P on `OSError: [Errno 28] No space left on device` instead of failing if the cluster has grown since we started Open

adaptive enhancement shuffle

dask/distributed#8674 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Track cluster growth during P2P operations Open

diagnostics enhancement shuffle

dask/distributed#8675 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
P2P tasks log compute failures even if they are later restarted Open

enhancement shuffle

dask/distributed#8679 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Swallowing the `CommClosedError` when the stream handler closes may remove relevant exception information Open

needs triage

dask/distributed#8683 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
PubSub functionality kills stream-based connections due to race conditions Open

bug

dask/distributed#8685 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Improve structure of event logging Open

diagnostics enhancement hygiene

dask/distributed#8688 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Worker plugin can not be registered on worker unless its entire package source uploaded on server Open

needs triage

dask/distributed#8695 · 7 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Add Prometheus metrics that tracks cumulative counts of handler calls Open

diagnostics feature

dask/distributed#8696 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add Prometheus metrics for cumulative task transition counts on workers Open

diagnostics feature

dask/distributed#8697 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Package upload plugin Open

enhancement

dask/distributed#8698 · 3 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
Tests fail with openssl 3 due to test certificates not meeting current standards Open

needs triage

dask/distributed#8701 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Using `log_event` in task with recursive object causes client to wait indefinitely Open

bug

dask/distributed#8704 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
distributed/tests/test_client.py::test_upload_file_zip fails on Python 3.13 Open

needs triage

dask/distributed#8708 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Outdated and/or unclear documentation about SchedulerPlugin Open

documentation enhancement

dask/distributed#8719 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
RuntimeError: Barrier task with key 'shuffle-barrier-379659673650beace1aa63b2956e7b58' does not exist. This may be caused by task fusion during graph generation. Please let us know that you ran into this by leaving a comment at distributed#7816. Open

needs info

dask/distributed#8720 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Improve documentation for registering plugins Open

documentation enhancement

dask/distributed#8721 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
MemoryState is taking non trivial amount of CPU time in dashboard Open

needs triage

dask/distributed#8726 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
GPU utilization not showing on MIG devices Open

bug gpu

dask/distributed#8739 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Adjust threshold for bad worker on worker table based on worker-ttl Open

diagnostics enhancement good first issue

dask/distributed#8749 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Bokeh's log level set on import affects Panel/Bokeh apps Open

needs triage

dask/distributed#8750 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Preload code provided by `--preload` does not kill worker on failure Open

needs triage

dask/distributed#8754 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`test_restarting_does_not_deadlock` flaky due to import error on deserialization Open

flaky test regression

dask/distributed#8759 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Repeated calls to `memory_color` take around 12% of CPU time of scheduler Open

needs triage

dask/distributed#8763 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Provide means to monitor which task / worker is holding the lock or semaphores Open

enhancement needs info

dask/distributed#8772 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Random access array take using P2P Open

feature shuffle

dask/distributed#8774 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
TimeoutError in distributed.nanny causing gRPC server crash after prolonged analysis Open

needs triage

dask/distributed#8775 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
P2P Shuffle blows up the task graph with increasing number of partitions Open

shuffle

dask/distributed#8779 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`test_upload_file_egg` started failing on `mindeps` CI Open

tests

dask/distributed#8784 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Scheduler deadlocked after stealing failed in `move_task_confirm` Open

bug deadlock

dask/distributed#8787 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Failure in a task submitted by another task can leave an "erred" task permanently on the cluster Open

needs triage

dask/distributed#8789 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Failed tasks persist in the Client even if the `Future` object falls out of scope, preventing Future deallocation/task cleanup from the cluster Open

needs triage

dask/distributed#8790 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Shut down scheduler on unrecoverable exceptions Open

enhancement scheduler

dask/distributed#8792 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`test_task_group_and_prefix_statistics` is very flaky on `mindeps-pandas` CI Open

flaky test

dask/distributed#8795 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Setting a basicConfig before importing distributed changes the scheduler logging level. Open

needs triage

dask/distributed#8805 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove data spilling that acts on `target` threshold Open

enhancement memory performance

dask/distributed#8820 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
test_jupyter_cli seems to be timing out regularly on main on all jobs Open

needs triage

dask/distributed#8825 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Propagate reason to client-side `FutureCancelledError` when closing the scheduler Open

enhancement

dask/distributed#8830 · 2 comments · 9 reactions · 0 assignees · Indexed Sep 15, 2026
`Client.compute(df)` operates on larger task graphs than `df.compute()` Open

bug

dask/distributed#8833 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Client submit with workers doesn’t handle new joining workers correctly Open

bug scheduling

dask/distributed#8862 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Memory leak when submitting futures Open

good second issue

dask/distributed#8859 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Adding futures into a `Queue` disables `resources` argument in `submit` function. Open

bug regression

dask/distributed#8860 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Improve error message when spilling runs out of disk Open

enhancement

dask/distributed#8863 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026

dask/distributed

Get new issues in your inbox