dask/dask-jobqueue

View on GitHub

Deploy Dask on job schedulers like PBS, SLURM, and SGE

Stars: 256
Forks: 150
Open beginner issues: 0
Indexed issues: 50

Dominant language: Python
License: BSD-3-Clause
Last GitHub push: Dec 19, 2025
Latest indexed: Sep 15, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted
PR merge metrics: No merged PRs in 30d

Open All

50 open issues indexed

Unified test suite Open

CI

dask/dask-jobqueue#8 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Implement a cluster status method, to know if workers are really running Open

all job schedulers

dask/dask-jobqueue#11 · 11 comments · 4 reactions · 0 assignees · Indexed Sep 15, 2026
Add LSF docker files to CI Open

help wanted LSF

dask/dask-jobqueue#115 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Use configurable templated header with jinja2 as in batchspawner Open

enhancement

dask/dask-jobqueue#133 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Allow to start a Scheduler in a batch job Open

all job schedulers

dask/dask-jobqueue#186 · 13 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
What to do with kwargs common to every JobQueueCluster impl (walltime, queue ...) Open

all job schedulers

dask/dask-jobqueue#202 · 10 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
LSF scheduler seems to have redundant memory keyword Open

LSF

dask/dask-jobqueue#205 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Document how to use book multiple cores for a single task Open

documentation sprint

dask/dask-jobqueue#231 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Jobqueue-specific Dask examples? Open

documentation

dask/dask-jobqueue#253 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
dask-jobqueue binder Open

documentation sprint

dask/dask-jobqueue#276 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Gather Logs Open

needs triage

dask/dask-jobqueue#299 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Document common cluster specific (but not job scheduler specific) quirks with work-arounds if available Open

documentation

dask/dask-jobqueue#356 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Limit number of jobs in queue or running with dask-jobqueue Open

question

dask/dask-jobqueue#365 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
how to use ucx protocol for the communication between workers and schedulers Open

question

dask/dask-jobqueue#371 · 14 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Connect to dask-scheduler from local workstation (maybe update documentation?) Open

documentation

dask/dask-jobqueue#377 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 15, 2026
SGECluster in multiple queues Open

enhancement question

dask/dask-jobqueue#378 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
tornado.application - ERROR - Exception in callback functools.partial(<bound method IOLoop._discard_future_result of <tornado.platform.asyncio.AsyncIOLoop object at 0x2ab42ba925d0>>, <Task finished coro=<Worker.heartbeat() done Open

question

dask/dask-jobqueue#389 · 16 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Instantiate a JobQueueCluster with an already started Scheduler Open

all job schedulers

dask/dask-jobqueue#419 · 6 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
Make job submission asynchronous Open

dask/dask-jobqueue#470 · 9 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Adaptive scaling and dask-jobqueue goes into endless loop when a job launches several worker processes (was: Different configs result in worker death) Open

bug usage question

dask/dask-jobqueue#498 · 17 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Why is the walltime is set by default? Open

documentation

dask/dask-jobqueue#500 · 15 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add RemoteSlurmJob to connect SLURMCluster to a remote Slurm cluster Open

enhancement SLURM

dask/dask-jobqueue#502 · 14 comments · 3 reactions · 0 assignees · Indexed Sep 15, 2026
Add support for dask-ctl Open

dask/dask-jobqueue#544 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Dask Jobqueue is not async ready Open

dask/dask-jobqueue#567 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
CI: Distributed fixtures not compliant with dask-jobqueue Open

dask/dask-jobqueue#569 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
dask-jobqueue for Fujitsu HPC Open

dask/dask-jobqueue#573 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove deprecated parameters `env_extra`, `extra`, `job_extra` Open

dask/dask-jobqueue#578 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Suppress "Couldn't detect a suitable IP address" messages on cluster nodes with no internet Open

dask/dask-jobqueue#585 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
`JobQueueCluster` with local worker(s) Open

dask/dask-jobqueue#596 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Restart cluster job on task completion Open

dask/dask-jobqueue#597 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add CI with more tests for OAR Open

CI OAR

dask/dask-jobqueue#599 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
a direct way to specify the worker spec Open

dask/dask-jobqueue#601 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 15, 2026
Documentation bug: interface Open

dask/dask-jobqueue#603 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
documentation: document `worker_command` kwarg Open

dask/dask-jobqueue#607 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Update NERSC Cori to NERSC Perlmutter in docs Open

dask/dask-jobqueue#609 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
ConnectionRefusedError Open

dask/dask-jobqueue#614 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Resource allocation on SLURM cluster Open

dask/dask-jobqueue#616 · 9 comments · 2 reactions · 0 assignees · Indexed Sep 15, 2026
Remove deprecated project kwarg in Cluster implementation, or use it as it should be Open

dask/dask-jobqueue#622 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Should we merge Dask HPC Runners in here? Open

dask/dask-jobqueue#638 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
More graceful job cancellation Open

enhancement help wanted

dask/dask-jobqueue#640 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
SGE Tests segfault in CI Open

bug CI SGE

dask/dask-jobqueue#653 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Use LSF blaunch command in LSFJob to start the workers in a multitask job Open

dask/dask-jobqueue#672 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Set interface in `SLURMRunner` Open

enhancement help wanted SLURM

dask/dask-jobqueue#681 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Unable to load scheduler dashboard in SLURMRunner, but can in cluster Open

needs info

dask/dask-jobqueue#682 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Improve documentation for `SLURMRunner` Open

dask/dask-jobqueue#686 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
jobs not resubmitted in `SLURMCluster` after graceful closure via `--lifetime` Open

bug

dask/dask-jobqueue#691 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Potential for SLURMCluster log directory creation failing Open

bug

dask/dask-jobqueue#692 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
core.py's Job class default regex not selecting correct job id Open

dask/dask-jobqueue#699 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Control idle time on SLURMCluster.adapt() to control when workers are released. Open

dask/dask-jobqueue#701 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
LSF broken for runtimes given in HH:MM:SS format Open

bug LSF

dask/dask-jobqueue#703 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026

dask/dask-jobqueue

Get new issues in your inbox