E3SM-Project / E3SM-Project/scorpio

Adding upper bound for number of I/O processes

Open
#125 2 comments 0 reactions 1 assignee Claimed by @jayeshkrishna View on GitHub
enhancement High Priority Next Release Perf
Dominant language
C++
Stars
22
Forks
20
Avg merge
12d 19m
Merged PRs (30d)
1

Description

We need to have a configure option to optionally add an
upper bound for the number of I/O processes in PIO.

The upper bound will override the number of I/O processes
set by the user (when it exceeds the upper bound).

Currently users can set the number of I/O tasks and I/O
stride. Setting the number of I/O tasks can limit the number
of I/O processes but having a common upper bound (that
can be configured on a per-machine basis) is useful
especially for high res runs.

Setting the upper bound is useful for machines where we
want to set the number of I/O processes close to the physical
I/O nodes on the machine. Limiting the number of I/O processes
has been useful in improving I/O performance of high res
E3SM runs in the past.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.