DynamoRIO / DynamoRIO/dynamorio

Run all tests in release build in long suite on master merge

Open
#5,360 2 comments 0 reactions 0 assignees View on GitHub
Component-Tests Hotlist-ContinuousIntegration Type-Feature
Dominant language
C
Stars
3.2k
Forks
629
Avg merge
2d 18h
Merged PRs (30d)
30

Description

Historically we've been focused on debug-build tests, under the assmption that it is pretty rare for an issue to happen only in release build. Debug build has extra checks that catch more errors. Today we run only a subset of tests in release build, based on that assumption and to keep the PR CI time down. But: we have a separate "long" suite on master merge where the time doesn't matter as much. We should enable all the tests in release-build there.

This is becoming more important as we have lately been seeing release-build-only failures: #4928, #4954, #2417 drcachesim.coherence.

Contributor guide

Open the contributing guide

Research direction

Start by locating the long suite that runs on master merge and inspect how it selects release-build tests. Compare that selection with the debug-build suite and the current release subset, then verify that the long suite runs all tests in release mode, including drcachesim.coherence; related failures are #4928, #4954, and #2417.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
build-system, ci-cd, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.