dask/distributed

View on GitHub

A distributed task scheduler for Dask

Stars: 1.7k
Forks: 778
Open beginner issues: 0
Indexed issues: 1.2k
Avg merge: 2h 50m
Merged PRs (30d): 3

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Aug 26, 2026
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted good first issue

Open All

1248 open issues indexed

Randomly at the end of a program I get an error that some temporary directory cannot be removed Open

needs info

dask/distributed#5322 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Scheduler underestimates data transfer cost for small transfers Open

discussion networking performance scheduling stealing

dask/distributed#5324 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`SystemError: unknown opcode` with compiled nested function Open

dask/distributed#5331 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Client cannot connect to scheduler when using multiprocessing Open

dask/distributed#5334 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
test_https_support fails on Python 3.10 Open

dask/distributed#5355 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Deadlock - task not running Open

dask/distributed#5366 · 23 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Change the memory-limit on the fly Open

enhancement memory

dask/distributed#5367 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Stress test crashes with StreamClosedError Open

dask/distributed#5371 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Document access to workers dashboard Open

documentation

dask/distributed#5373 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`xarray` data objects not being accounted in the worker's managed memory Open

dask/distributed#5383 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Slow execution time on very large k8s-backed dask cluster Open

dask/distributed#5384 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Performance report compute time stats are inaccurate with lots of tasks Open

diagnostics good second issue

dask/distributed#5401 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Retry collection of tasks on failed worker Open

dask/distributed#5403 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
test_bad_local_directory fails if run with root permissions on Linux. Open

dask/distributed#5404 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
self.connection.run("cmd /c ver") causing problems Open

dask/distributed#5411 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[DEV DOCS] Networking in distributed Open

documentation

dask/distributed#5414 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[DEV DOCS] Journey of a task - HLG edition Open

documentation

dask/distributed#5415 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[DEV DOCS] Cythonization Open

documentation

dask/distributed#5416 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[DEV DOCS] Cluster and Adaptive classes Open

documentation

dask/distributed#5417 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Better error for missing modules during deserialization Open

documentation

dask/distributed#5419 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Memory leak in gather() Open

dask/distributed#5430 · 11 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
Enhancement Request - Scatter based on worker memory availability Open

dask/distributed#5451 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Distributed scheduler failure case Open

dask/distributed#5453 · 2 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
Creating LocalCluster with processes through reticulate in R hangs on Windows Open

dask/distributed#5461 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Allow NannyPlugins to handle worker process terminations Open

dask/distributed#5465 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`get_client` returns different Clients in different worker threads Open

dask/distributed#5466 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Better documentation of required open ports Open

documentation networking

dask/distributed#5479 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Is it intended that any error from a handler makes `Server.handle_stream` close the comm? Open

dask/distributed#5483 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Replace worker use of `threading.local()` with ContextVar Open

enhancement

dask/distributed#5485 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`test_reschedule_concurrent_requests_deadlock` flaky Open

flaky test

dask/distributed#5494 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
TypeError when serializing tuples of dataclasses Open

dask/distributed#5495 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
When using a local cluster, shuffle with disk Open

dask/distributed#5502 · 8 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
`test_aliases_2` flaky? Open

flaky test

dask/distributed#5516 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Prevent overwrite worker plugins Open

dask/distributed#5538 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Potentially flaky `test_stress` and `test_ucx_protocol[1234]` UCX tests Open

flaky test

dask/distributed#5542 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Dask security support encrypted private key Open

dask/distributed#5547 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
various errors when invoking `dask.distributed.LocalCluster` with custom host (and port) Open

needs info

dask/distributed#5550 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Merging using ```shuffle = 'disk'``` is 25x slower than when using ```shuffle='tasks'``` Open

dask/distributed#5554 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Distributed scheduler does not obey dask.order.order for num_workers=1, num_threads=1 Open

dask/distributed#5555 · 11 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
Set scheduler log sizes automatically based on available memory Open

diagnostics documentation stability

dask/distributed#5570 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
SpecCluster calls scheduler.retire_workers incorrectly Open

dask/distributed#5577 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Handle non-msgpack serializable data in Queues Open

dask/distributed#5580 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Expunge unresponsive workers in less than 10s Open

bug p3

dask/distributed#5585 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
AttributeError when spinning up Coiled clusters with distributed==2021.12.0 Open

dask/distributed#5588 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Hanging when using python multiprocessing along with dask.distributed Open

needs info

dask/distributed#5596 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
workload not balancing during scale up on dask-gateway Open

adaptive needs info stealing

dask/distributed#5599 · 6 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Broken SSL in MacOS CI Open

dask/distributed#5601 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Can't (de)serialize NamedTuple objects Open

dask/distributed#5602 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Actor not released from worker memory, inducing memory leak Open

dask/distributed#5610 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
KilledWorker exception with dask dataframes Open

dask/distributed#5611 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

dask/distributed

Get new issues in your inbox