llnl / llnl/benchpark

Add memory info to the systems

Open
#937 1 comment 0 reactions 1 assignee View on GitHub

@stephanielam3211 is already working on this.

Since Jul 30, 2025.

  • #942 by @stephanielam3211 — merged
system
Dominant language
Python
Stars
78
Forks
52
Avg merge
4d 19m
Merged PRs (30d)
10

Description

  • Test to make sure they get stored in caliper metadata after experiment runs - look here.
  • What can you automatically extract from hwloc info? Start with @amroakmal's script and write a helper script
  • There may be more information in /etc/node_info.json on some of the LC machines

Units and how to organize the data

  • Use the same units as hwloc, add them in the name of the variable, e.g., sys_cpu_L1_KB_per_core, sys_mem_GB_per_node
  • check that the units make sense for the cheapest/smallest CPU on AWS (we can't do fractions)
  • If hwloc is reporting X L1s per node, we should also - so update our variables to sys_cpu_L1_KB_per_core (we already have sys_num_cpu_cores) and `

Types of counters

  • sys_mem_GB_per_node
  • sys_cpu_mem_GB_per_node (same as sys_mem_per_node in CPU-only)
  • sys_gpu_mem_GB_per_node (if separate from CPU memory)
  • sys_cpu_L1_KB_per_core
  • sys_gpu_L1_KB_per_device
  • sys_gpu_num_L1_per_node
  • sys_cpu_L2_MB_per_node
  • sys_gpu_L2_MB_per_node
  • sys_gpu_num_L2
  • sys_cpu_L3_MB_per_node
  • sys_gpu_L3_MB_per_node
  • sys_gpu_num_L3
  • sys_num_nodes_per_rack
  • sys_num_racks
  • sys_network_topology (what is available in hwloc on this?)

If you are finding that the counter names are not a good match for what we have on CPU clusters and on El Cap, lets discuss here

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.