dask / dask/dask-jobqueue

Document how to use book multiple cores for a single task

Open
#231 3 comments 0 reactions 0 assignees View on GitHub
documentation sprint
Dominant language
Python
Stars
256
Forks
150
PR merge metrics
No merged PRs in 30d

Description

This is to clarify one of the outcome of #181.

Several people have asked how they can use dask-jobqueue to submit multi-threaded tasks. There are two answers currently:

- we can use `resource_spec` or specific scheduler equivalent kwarg to book more cores than nprocs*nthreads started with dask-worker.
- or we can use `resources` functionnality, which allows to submit both multi-threaded or single threaded tasks on the same cluster.

This needs to be documented.

@lesteve made up some examples: see https://github.com/dask/dask-jobqueue/issues/181#issuecomment-449341161.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.