microsoft / microsoft/onnxruntime-genai
With Latest GeForce Driver v555 - Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.
Open
ep:DML
- Dominant language
- C++
- Stars
- 1.1k
- Forks
- 354
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 85
Description
Upgraded to the latest GeForce driver v555 and using Phi-3- medium-instruct 128K on a RTX 4090 Windows 11 PC.
Same C# code that does inference is throwing an exception at generator.ComputeLogits();
Microsoft.ML.OnnxRuntimeGenAI.OnnxRuntimeGenAIException: 'D:\a\_work\1\onnxruntime-genai\src\dml\dml_command_recorder.cpp(143)\onnxruntime-genai.DLL!00007FFE7A4957F8: (caller: 00007FFE7A4959AD) Exception(1) tid(46d8) 887A0006 The GPU will not respond to more commands, most likely because of an invalid command passed by the calling application.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.