dotnet / dotnet/diagnostics

SOS.Tests local CI execution is unsupported or exceeds leg timeout

Open
#5,997 0 comments 0 reactions 0 assignees View on GitHub
Known Build Error
Dominant language
C++
Stars
1.3k
Forks
404
Avg merge
2d 3h
Merged PRs (30d)
38

Description

## Build Information
Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1578741
Leg Name: Ubuntu_22_04_x64_Debug, Ubuntu_22_04_x64_Release, MacOS_Test_x64_Debug, MacOS_Test_x64_Release, Windows_Test_x86_Release, Alpine3_23_x64_Debug, Alpine3_23_x64_Release

## Error Message

```json
{
"ErrorPattern": "(?:The job running on agent .+ ran longer than the maximum time of 180 minutes|XUnit.*Tests failed: .*[\\\\/]SOS\\.Tests_net10\\.0_x86\\.html|XUnit.*Tests failed: .*[\\\\/]artifacts[\\\\/]log[\\\\/](?:Debug|Release)[\\\\/]SOS\\.Tests_net10\\.0_x64\\.log)",
"BuildRetry": false,
"ExcludeConsoleLog": false
}
```

The new SOS.Tests harness runs a large host/runtime/flavor/dump/DAC matrix. Running the complete matrix in the existing local test legs causes three related temporary CI failures:

- Ubuntu and macOS test legs exceed the 180-minute job limit.
- Windows x86 loads the x64 `hostfxr.dll` (`0x800700C1`), followed by cascading EngineHost timeouts and test failures.
- Alpine attempts to execute the transferred glibc-targeted SOS.Tests apphost and reports `SOS.Tests: not found` on musl.

#5981 moves SOS.Tests to capture-family-sharded Helix work items, uses a shared platform payload, invokes `dotnet SOS.Tests.dll` on musl, and gates unsupported configurations. Until that integration lands, affected local SOS.Tests executions should be skipped without skipping the repository's existing non-SOS tests.

### Known issue validation
**Build: :mag_right:** https://dev.azure.com/dnceng-public/public/_build/results?buildId=1578741
**Error message validated:** `[(?:The job running on agent .+ ran longer than the maximum time of 180 minutes|XUnit.*Tests failed: .*[\\/]SOS\.Tests_net10\.0_x86\.html|XUnit.*Tests failed: .*[\\/]artifacts[\\/]log[\\/](?:Debug|Release)[\\/]SOS\.Tests_net10\.0_x64\.log)`]
**Result validation:** :white_check_mark: Known issue matched with the provided build.
**Validation performed at:** 9/2/2026 9:56:44 PM UTC

### Report
|Build|Repository|Step Name|Console log|Pull Request|
|---|---|---|---|---|
|[1591627](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1591627)|dotnet/diagnostics|MacOS_arm64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1591627/logs/200)|dotnet/diagnostics#6024|
|[1589773](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1589773)|dotnet/diagnostics|Alpine3_23_x64_Debug|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1589773/logs/381)|dotnet/diagnostics#6018|
|[1583056](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1583056)|dotnet/diagnostics|Test|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1583056/logs/250)|dotnet/diagnostics#6001|
|[1583054](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1583054)|dotnet/diagnostics|Test|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1583054/logs/253)|dotnet/diagnostics#6000|
|[1583048](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1583048)|dotnet/diagnostics|Test|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1583048/logs/253)|dotnet/diagnostics#5999|
|[1582993](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1582993)|dotnet/diagnostics|Test|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1582993/logs/252)|dotnet/diagnostics#6008|
|[1582101](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1582101)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1582101/logs/336)||
|[1582214](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1582214)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1582214/logs/351)|dotnet/diagnostics#6008|
|[1581311](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1581311)|dotnet/diagnostics|MacOS_Test_x64_Debug|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1581311/logs/351)|dotnet/diagnostics#6005|
|[1580729](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1580729)|dotnet/diagnostics|MacOS_Test_x64_Debug|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1580729/logs/351)|dotnet/diagnostics#5999|
|[1580300](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1580300)|dotnet/diagnostics|MacOS_Test_x64_Debug|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1580300/logs/351)|dotnet/diagnostics#5980|
|[1580405](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1580405)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1580405/logs/264)||
|[1580102](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1580102)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1580102/logs/349)|dotnet/diagnostics#6004|
|[1580076](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1580076)|dotnet/diagnostics|MacOS_Test_x64_Debug|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1580076/logs/346)|dotnet/diagnostics#5993|
|[1579837](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1579837)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1579837/logs/351)|dotnet/diagnostics#5999|
|[1579739](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1579739)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1579739/logs/264)||
|[1578741](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1578741)|dotnet/diagnostics|MacOS_Test_x64_Release|[Log](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_apis/build/builds/1578741/logs/351)|dotnet/diagnostics#5979|
#### Summary
|24-Hour Hit Count|7-Day Hit Count|1-Month Count|
|---|---|---|
|0|2|17|

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the existing local test legs and the SOS.Tests harness behavior described here, then read issue #5981 for the planned sharding and platform handling. Done means affected local SOS.Tests executions are skipped without skipping the repository's existing non-SOS tests, while the timeout, Windows x86, and Alpine failures no longer occur.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
ci-cd, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.