HDFGroup / HDFGroup/hermes

Multi-node checkpoint/restart benchmark on Fronterra

Open
#260 1 comment 0 reactions 1 assignee Claimed by @ChristopherHogan View on GitHub
Dominant language
C++
Stars
34
Forks
19
PR merge metrics
No merged PRs in 30d

Description

We want to model a checkpoint/restart workload.

* 4 client nodes, with 48 ranks each (out of 56)
* Treat `${SCRATCH}` as the PFS, or final destination.
* Tiers are `/tmp`, which is an nvme, and `RAM`.
* Run Hermes as a daemon
* Run `ior -w` to simulate a checkpoint
* Run `ior -r` to simulate a restart
* For the baseline, the checkpoint phase will exit once the data is flushed to PFS, and the restart phase will read from PFS.
* Hermes will store the checkpoint in the hierarchy and we should see faster write and read.

Blocked by ~~#181~~, and #266.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.