dotnet / dotnet/dnceng

Infra timeout causing "Unable to obtain kernel buffer"

Open
#4,547 0 comments 0 reactions 0 assignees View on GitHub
First Responder Known Build Error
Dominant language
C#
Stars
31
Forks
38
Avg merge
1d 19h
Merged PRs (30d)
26

Description

### Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=879974

The tests succeeded (some long-running), but afterwards there was an errror message:
```
----- end Tue Nov 26 14:19:02 EST 2024 ----- exit code 0 ----------------------------------------------------------
exit code 0 means Exited Successfully
Unable to obtain kernel buffer: Operation not permitted
```

### Build leg reported

System.Text.Json.Tests.WorkItemExecution

### Pull Request

https://github.com/dotnet/runtime/pull/110097

### Known issue core information

Fill out the known issue JSON section by following the [step by step documentation on how to create a known issue](https://github.com/dotnet/arcade/blob/main/Documentation/Projects/Build%20Analysis/KnownIssueJsonStepByStep.md#how-to-create-a-known-issue-step-by-step)

```json
{
"ErrorMessage" : "'System.Text.Json.Tests' END OF WORK ITEM LOG: Command timed out, and was killed",
"BuildRetry": false,
"ErrorPattern": "",
"ExcludeConsoleLog": false
}
```

@dotnet/dnceng

log
```
/private/tmp/helix/working/B2A909DA/w/AA7A0952/e /private/tmp/helix/working/B2A909DA/w/AA7A0952/e
Discovering: System.Text.Json.Tests (method display = ClassAndMethod, method display options = None)
Discovered: System.Text.Json.Tests (found 8725 of 8795 test cases)
Starting: System.Text.Json.Tests (parallel test collections = on [4 threads], stop on fail = off)
System.Text.Json.Tests: [Long Running Test] 'System.Text.Json.Serialization.Tests.JsonElementTests.DeepEquals_TooDeepJsonDocument_ThrowsInsufficientExecutionStackException', Elapsed: 00:04:27
System.Text.Json.Tests: [Long Running Test] 'System.Text.Json.Serialization.Tests.JsonElementTests.DeepEquals_TooDeepJsonDocument_ThrowsInsufficientExecutionStackException', Elapsed: 00:06:29
Finished: System.Text.Json.Tests
=== TEST EXECUTION SUMMARY ===
System.Text.Json.Tests Total: 41670, Errors: 0, Failed: 0, Skipped: 0, Time: 868.437s
/private/tmp/helix/working/B2A909DA/w/AA7A0952/e
----- end Tue Nov 26 14:19:02 EST 2024 ----- exit code 0 ----------------------------------------------------------
exit code 0 means Exited Successfully
Unable to obtain kernel buffer: Operation not permitted
usage: sudo dmesg
XUnitLogChecker status: 1
----- start =============== XUnitLogChecker Output =====================================================
No dumps found in /cores.
----- end =============== XUnitLogChecker Output - exit code 0 ===========================
+ export _commandExitCode=0
+ _commandExitCode=0
+ /usr/local/bin/python3 /tmp/helix/working/B2A909DA/p/reporter/run.py https://dev.azure.com/dnceng-public/ public 22986740 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6IjdSd2F5dmlYRHFoZnN6MTZSNmxPbXNXWWxTQSJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiI2ZjViYmE1ZC1lZWU1LTQ4NzQtOWMzMy04YmYzMDM3M2JjOGEiLCJzaWQiOiI2MzFhODBiNy0yM2RlLTRhOTctYTM4NC0xMDFlYTU3MDlkMDMiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5Ozg3OTk3NCIsIkRlZklkIjoiMTI5Iiwiam9icmVmIjoiOWU2ZWRhMDMtOTNmYS00ODQzLWFjZTgtZDA0ZWNiNzI5N2Q1OjY5YjYwYjUzLWE0MTctNTZlOS1kNGUwLTNhNDAzNDRkNWU2NyIsInBwaWQiOiJ2c3RmczovLy9CdWlsZC9CdWlsZC84Nzk5NzQiLCJvcmNoaWQiOiI5ZTZlZGEwMy05M2ZhLTQ4NDMtYWNlOC1kMDRlY2I3Mjk3ZDUuYnVpbGQubGlicmFyaWVzX3Rlc3RfcnVuX2NoZWNrZWRfY29yZWNscl9vc3hfeDY0X2RlYnVnLl9fZGVmYXVsdCIsInJlcG9JZHMiOiIiLCJpc3MiOiJhcHAudnN0b2tlbi52aXN1YWxzdHVkaW8uY29tIiwiYXVkIjoiYXBwLnZzdG9rZW4udmlzdWFsc3R1ZGlvLmNvbXx2c286NmZjYzkyZTUtNzNhNy00Zjg4LThkMTMtZDkwNDViNDVmYjI3IiwibmJmIjoxNzMyNjQ2NjE3LCJleHAiOjE3MzI2NTY4MTd9.cC2SRXCXtsOpTBOQFXJsYZWgT9I8INckKrzLAlwfE9UFPQROpQGXjLn1pC3JbKSq6O9ZTBzqtKzCUL_45mPdNyxrElGg9dWsG9zIPCmN8Rzhs9Jmou17iOtSgWQ0BqpiZuieVhZJkGqVdQLRhNMHuB9oChkunLX-LQzOI7WgSH20jJCHavHBPveDywEdO1_o7fQOxWVdMOhgnScNK6DczXkQMhMqWPeLmisfk_sZJ1tAk5q2HoLyKWMlX4zzMlAMA7bdcfarsm_NC4XQmyxr0yfYiOYChDOzrRFg3Jfm-kCrH5KraJyeQoh14_fB_M9fjk0IPQSGr4DLzr66EcXBsA
2024-11-26T19:19:04.189Z INFO run.py run(48) main Beginning reading of test results.
2024-11-26T19:19:04.194Z INFO run.py __init__(42) read_results Searching '/private/tmp/helix/working/B2A909DA/w/AA7A0952/e' for test results files
2024-11-26T19:19:04.201Z INFO run.py __init__(48) read_results Found results file /private/tmp/helix/working/B2A909DA/w/AA7A0952/e/testResults.xml with format xunit
['System.Text.Json.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]
```

### Release Note Category
- [ ] Feature changes/additions
- [ ] Bug fixes
- [ ] Internal Infrastructure Improvements
### Release Note Description

### Additional information about the issue reported

_No response_

### Known issue validation
**Build: :mag_right:** https://dev.azure.com/dnceng-public/public/_build/results?buildId=879974
**Error message validated:** `['System.Text.Json.Tests' END OF WORK ITEM LOG: Command timed out, and was killed`]
**Result validation:** :white_check_mark: Known issue matched with the provided build.
**Validation performed at:** 11/26/2024 8:06:58 PM UTC

### Report

|Build|Repository|Test|Pull Request|
|---|---|---|---|
|[1595161](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1595161)|dotnet/runtime|[System.Text.Json.Tests.WorkItemExecution](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1595161&view=ms.vss-test-web.build-test-results-tab&runId=44037534&resultId=174631)||
|[1592126](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1592126)|dotnet/runtime|[System.Text.Json.Tests.WorkItemExecution](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1592126&view=ms.vss-test-web.build-test-results-tab&runId=43947866&resultId=174372)||
|[1591642](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1591642)|dotnet/runtime|[System.Text.Json.Tests.WorkItemExecution](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1591642&view=ms.vss-test-web.build-test-results-tab&runId=43933596&resultId=174691)||
|[1582596](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1582596)|dotnet/runtime|[System.Text.Json.Tests.WorkItemExecution](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1582596&view=ms.vss-test-web.build-test-results-tab&runId=43659600&resultId=174936)||
|[1581852](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1581852)|dotnet/runtime|[System.Text.Json.Tests.WorkItemExecution](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1581852&view=ms.vss-test-web.build-test-results-tab&runId=43651316&resultId=174262)||
#### Summary
|24-Hour Hit Count|7-Day Hit Count|1-Month Count|
|---|---|---|
|1|3|5|

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked build and the System.Text.Json.Tests.WorkItemExecution log, then follow the known issue JSON step-by-step documentation in the linked Arcade file. Confirm the timeout error pattern and build-leg details, and verify that the resulting known issue matches the build validation report.

Written by the indexing model from the issue text.

Assessment

Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.