JuliaParallel / JuliaParallel/DagScheduler.jl

make executors dynamic and resilient to failure

Open
#6 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Julia
Stars
10
Forks
1
PR merge metrics
No merged PRs in 30d

Description

- an execution node consists of a broker and some executors on one physical node
- execution nodes can join/drop off the cluster
- master node, from where broad level scheduling is done
- maps critical dag nodes to physical nodes
- monitors progress, and reallocates dag nodes if brokers fail/drop off
- allows new brokers to join dynamically

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.