ipython / ipython/ipyparallel

Retry engines that raise UnmetDependency

Open
#247 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.6k
Forks
1k
PR merge metrics
No merged PRs in 30d

Description

I'm using ipyparallel in a somewhat hackneyed scheme as a GPU cluster - upon job submission, each engine checks to see whether there are available GPU resources for running the job, and reports back to the scheduler if not. This can be accomplished with `@depend`, if the Scheduler can be set to not blacklist engines that raise dependency errors. What I'm really looking for is a `resource_busy` error though.

Is it possible to disable engine blacklist upon raising dependency errors? Or, even better, to more directly tell the scheduler that an engine is busy?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.