dotnet / dotnet/performance

[Tracking] Disabled WasmCoreCLR Performance Tests from PR #5135

Open
#5,136 0 comments 0 reactions 1 assignee Claimed by @LoopedBard3 View on GitHub
impact test coverage
Dominant language
F#
Stars
773
Forks
301
Avg merge
6d 9h
Merged PRs (30d)
15

Description

This tracking issue documents the set of performance tests disabled for WasmCoreCLR as implemented in [PR #5135](https://github.com/dotnet/performance/pull/5135).

### Summary
In PR #5135, the `Categories.NoWasmCoreCLR` attribute was added to 32 benchmarks across 14 files due to persistent timeouts exceeding the 20-minute limit during WasmCoreCLR BenchmarkDotNet (BDN) test runs. Temporarily disabling these tests enables CI stabilization and further investigation.

### Disabled Benchmarks (via NoWasmCoreCLR):
- **Burgers**
- **ByteMark**
- **ConsoleMandel**
- **LinqBenchmarks**
- **MandelBrot_7**
- **MDArray2**
- **MDInProd**
- **MDMulMatrix**
- **MDSqMtx**
- **Perf_StreamWriter**
- **RayTracerBench**
- **SeekUnroll**
- **Sort**
- **SortingTests**

For further details, refer to CI build links:
- Wasm CoreCLR test timeout sample: https://dev.azure.com/dnceng/internal/_build/results?buildId=2915976&view=results

[clr-log1.txt](https://github.com/user-attachments/files/25710315/clr1-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log2.txt](https://github.com/user-attachments/files/25710317/clr2-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log3.txt](https://github.com/user-attachments/files/25710418/clr3-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log4.txt](https://github.com/user-attachments/files/25710419/clr4-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log5.txt](https://github.com/user-attachments/files/25710423/clr5-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)

- Successful NoWasmCoreCLR test run: https://dev.azure.com/dnceng/internal/_build/results?buildId=2916496&view=results

---
#### Next Steps
- Track the impact on performance coverage.
- Revisit these benchmarks after future improvements or investigations into the WasmCoreCLR runtime performance and CI stability.
- See [PR #5135 discussion](https://github.com/dotnet/performance/pull/5135) for context and links to excluded files.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.