llnl / llnl/UMT

Unexpected change in performance and correctness check output since tag v5.5.0

Open
#29 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Fortran
Stars
8
Forks
11
PR merge metrics
No merged PRs in 30d

Description

Hi folks,

Using v.5.5.0 I get output from:

mpirun -n 112 --map-by numa --bind-to core ./test_driver -c 20 -B global -d 14,14,14 --sweep_kernel=0 --benchmark_problem=1 -t 1
=================================================================
Test driver finished time steps
=================================================================
Average throughput of single iteration of iterative solver was 6.30546e+09 unknowns calculated per second.
Throughput of iterative solver was 5.81149e+08 unknowns calculated per second.
(average throughput of single iteration * # iterations for solver to produce answer

Total number of flux solver iterations for run: 217
Total wall time for run: 167.098 seconds.
=================================================================

RESULT CHECK PASSED: Energy check (this is relative to total energy) 1.04324e-15 within tolerance of +/- 1e-09; check './unnamed.csv' for tally details

Compared to latest head I get output from:

mpirun -n 112 --map-by numa --bind-to core ./test_driver -c 20 -B global -d 14,14,14 --sweep_kernel=0 --benchmark_problem=1 -t 1
=================================================================
Test driver finished time steps
Simulation time progressed: 3.503887e-03
Number of cycles: 20
Total wall time for run: 7.056378e+01 seconds.
=================================================================

=================================================================
Test driver throughput statistics

Definition of flux solver throughput:
  # unknowns calculated * simulation time progressed / wall time
Definition of single flux iteration throughput:
  # flux solver throughput / number of flux iterations taken

=================================================================
Problem throughput: 2.410993e+05
=================================================================

Is this expected change in behavior?
Is there an easy way of comparing these two runs in terms of performance?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the exact mpirun command against tag v5.5.0 and the latest head, recording the correctness and throughput output from each run. Inspect the changes between those revisions that affect test_driver output, timing, or result checking. Done means explaining whether the output change is expected and providing a reliable way to compare the two runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
fortran
Domain
hpc, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.