dask / dask/dask-mpi

Launching dask-mpi clusters

Open
#44 24 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
56
Forks
29
PR merge metrics
No merged PRs in 30d

Description

Is this supported? We have the ability (through Slurm) to `srun ... dask-mpi...` which will launch the cluster on a queue set aside for interactive work. From the command line it's a single command. Other facilities may not have this capability (it may require a batch script).

We're willing to take a look into how to make this work if it's needed. cc @shreddd

Contributor guide

Open the contributing guide

Research direction

Start at the dask-mpi command-line entry point and inspect how launching through Slurm's `srun` is handled. Determine whether interactive queue launches are supported; done means a documented, working path for `srun ... dask-mpi`, or a clear explanation of batch-script requirements and unsupported facilities.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.