dotnet / dotnet/machinelearning

Flaky test LLaMA3_1Tests.Llama_3_1_405b_ShapeTest

Open
#7,706 1 comment 0 reactions 0 assignees View on GitHub
blocking-clean-ci Known Build Error untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

## Build Information
Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1589489
Build error leg or test failing: Microsoft.ML.GenAI.LLaMA.Tests.LLaMA3_1Tests.Llama_3_1_405b_ShapeTest
Pull request: https://github.com/dotnet/machinelearning/pull/7704

## Error Message

**DO NOT USE JSON BELOW IF THIS IS A BUILD BREAK** otherwise build analysis will allow pull requests to merge that break the build worse. For a build break, do not use this issue form. Make a regular new issue.

Fill the error message using [step by step known issues guidance](https://github.com/dotnet/arcade/blob/main/Documentation/Build%20Analysis/KnownIssueJsonStepByStep.md).

```json
{
"ErrorMessage": ["LLaMA3_1Tests.Llama_3_1_405b_ShapeTest", "SEHException : External component has thrown an exception."]
"BuildRetry": false,
"ExcludeConsoleLog": false
}
```

```
Failing Configuration
Machinelearning_Tests_Windows_x64_Debug_20260909.6
Exception Message
System.Runtime.InteropServices.SEHException : External component has thrown an exception.
CallStack
at TorchSharp.PInvoke.NativeMethods.THSNN_Module_to_dtype(HType module, SByte dtype, Boolean non_blocking)
at TorchSharp.torch.nn.Module._to(ScalarType dtype, Boolean non_blocking)
at TorchSharp.torch.nn.Module.MoveModule[T](Device device, Nullable`1 dtype)
at TorchSharp.torch.nn.Linear(Int64 inputSize, Int64 outputSize, Boolean hasBias, Device device, Nullable`1 dtype)
at Microsoft.ML.GenAI.LLaMA.LlamaForCausalLM..ctor(LlamaConfig config, String device) in D:\a\_work\1\s\src\Microsoft.ML.GenAI.LLaMA\LlamaForCausalLM.cs:line 45
at Microsoft.ML.GenAI.LLaMA.Tests.LLaMA3_1Tests.Llama_3_1_405b_ShapeTest() in D:\a\_work\1\s\test\Microsoft.ML.GenAI.LLaMA.Tests\LLaMA3_1Tests.cs:line 57
at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
```

### Report
#### Summary
|24-Hour Hit Count|7-Day Hit Count|1-Month Count|
|---|---|---|
|0|0|0|

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.