[Tracking] Disabled WasmCoreCLR Performance Tests from PR #5135
- Dominant language
- F#
- Stars
- 773
- Forks
- 301
- Avg merge
- 6d 9h
- Merged PRs (30d)
- 15
Description
This tracking issue documents the set of performance tests disabled for WasmCoreCLR as implemented in [PR #5135](https://github.com/dotnet/performance/pull/5135).
### Summary
In PR #5135, the `Categories.NoWasmCoreCLR` attribute was added to 32 benchmarks across 14 files due to persistent timeouts exceeding the 20-minute limit during WasmCoreCLR BenchmarkDotNet (BDN) test runs. Temporarily disabling these tests enables CI stabilization and further investigation.
### Disabled Benchmarks (via NoWasmCoreCLR):
- **Burgers**
- **ByteMark**
- **ConsoleMandel**
- **LinqBenchmarks**
- **MandelBrot_7**
- **MDArray2**
- **MDInProd**
- **MDMulMatrix**
- **MDSqMtx**
- **Perf_StreamWriter**
- **RayTracerBench**
- **SeekUnroll**
- **Sort**
- **SortingTests**
For further details, refer to CI build links:
- Wasm CoreCLR test timeout sample: https://dev.azure.com/dnceng/internal/_build/results?buildId=2915976&view=results
[clr-log1.txt](https://github.com/user-attachments/files/25710315/clr1-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log2.txt](https://github.com/user-attachments/files/25710317/clr2-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log3.txt](https://github.com/user-attachments/files/25710418/clr3-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log4.txt](https://github.com/user-attachments/files/25710419/clr4-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
[clr-log5.txt](https://github.com/user-attachments/files/25710423/clr5-micro.wasm_coreclr.wasm.coreclr_v8.linux.x64.perfviper.net11.0.txt)
- Successful NoWasmCoreCLR test run: https://dev.azure.com/dnceng/internal/_build/results?buildId=2916496&view=results
---
#### Next Steps
- Track the impact on performance coverage.
- Revisit these benchmarks after future improvements or investigations into the WasmCoreCLR runtime performance and CI stability.
- See [PR #5135 discussion](https://github.com/dotnet/performance/pull/5135) for context and links to excluded files.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.