dask / dask/distributed

Support using the `--preload` scheduler CLI flag alongside the `scheduler.preload` configuration options

Open
#7,342 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

This is not documented, but it seems that you cannot use the `--preload` scheduler CLI flag with the `distributed.scheduler.preload` configuration option.

The preload config is only read if _no_ `--preload` argument is used (https://github.com/dask/distributed/blob/2963bf12ec1fd27357360b01598f70fac2fe1750/distributed/scheduler.py#L3551-L3552).

You may have no control over the `--preload` option, or you want to set the preload option dynamically via environment variables. In this case it seems impossible to run any preload scripts on the scheduler.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.