E3SM-Project / E3SM-Project/scorpio

Asynchronous I/O requirements

Open
#489 6 comments 0 reactions 1 assignee Claimed by @jayeshkrishna View on GitHub
enhancement
Dominant language
C++
Stars
22
Forks
20
Avg merge
12d 19m
Merged PRs (30d)
1

Description

These are suggested features for the asynchronous I/O support in the library.

@ambrad :

- Summit: 6 resource sets (RS) per node. 1 rank per RS drives the 1 GPU/RS. a second rank per RS drives I/O for the RS.
- can choose async/sync per file. e.g., do it only for restart files.
- if MPI comm b/w for I/O can be large, provide an option to throttle it. e.g., a mid-run restart file could take several hours to write asynchronously and with throttled comm. perhaps there would have to be a throttle-override call that would tell PIO to run at max speed at the end of a run.
- all operations in addition to writing that can be async should support it: e.g., openfile, initdecomp, closefile
- related: support ADIOS vs PNETCDF per file.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.