ESCOMP / ESCOMP/CAM

Out of memory issue in CAM at ne1024 resolution

Open
#1,640 0 comments 0 reactions 2 assignees Claimed by @jtruesdal View on GitHub
enhancement
Dominant language
No language data
Stars
91
Forks
183
Avg merge
6d 2m
Merged PRs (30d)
9

Description

### What is the feature/what would you like to discuss?

CAM initialization consumes excessive memory (and time) at very high resolution (e.g. ne1024), to the point of risking out-of-memory during startup. Currently we have to undersubscribe a compute node on Derecho, which is probably unavoidable, but we are seeking ways to reduce the memory usage in CAM initialization.

A large fraction of the per-rank init footprint is the read-only lookup tables that are bit-identical on every rank — photolysis cross-sections and radiative source functions, aerosol optics tables, soil erodibility, and the global lat-lon source fields staged by `tracer_data`. Every rank allocates and holds its own copy, so the node-level cost scales with ranks-per-node while the useful information does not.

### Is there anyone in particular you want to be part of this conversation?

@jtruesdal

### Will this change (regression test) answers?

No

### Will you be implementing this enhancement yourself?

Yes

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.