Performance

For improved reliability, the machine needs some setup. Maybe we can validate that automatically?

Guides:

• https://google.github.io/benchmark/reducing_variance.html
• https://juliaci.github.io/BenchmarkTools.jl/stable/linuxtips/
• https://llvm.org/docs/Benchmarking.html
• https://wiki.archlinux.org/title/CPU_frequency_scaling
• sudo python -mpyperf system tune

Once (total, in BIOS)

• Disable Hyperthreading/SMT (looks complex, prefer doing in BIOS)

Per boot

• Global setup:

  Use performance governor for all CPUS
  Disable processor boosting
  Reduce swappiness
  No ASLR

  tentative script so far:

  # performance governor
  echo "performance" | sudo tee /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor
  # no boosting
  echo 0 | sudo tee /sys/devices/system/cpu/cpufreq/boost
  # low swappiness
  sudo sysctl vm.swappiness=10
  # no ASLR
  sudo sysctl kernel.randomize_va_space=0
  

• Assign roles to CPUS:

  • Make sure no timed services run on the CPUs used in benchmarks (processor shielding)
  • Set up interrupts (SMP affinity)

Per run

• Set the benchmark program’s task affinity to a fixed cpu. (ASV: --cpu-affinity, subprocess: taskset -c 0 ./mybenchmark)

Start by reviewing the linked LLVM, CPU frequency scaling, and pyperf system-tuning guides, then inspect the tentative Nushell commands and the listed ASV --cpu-affinity and taskset entry points. Done should mean the benchmark environment can automatically validate or apply the documented per-boot and per-run setup.