microsoft / microsoft/onnxruntime-genai
Issues running on Ryzen
- Dominant language
- C++
- Stars
- 1.1k
- Forks
- 354
- Avg merge
- 2d 16h
- Merged PRs (30d)
- 85
Description
Using phi3 vision model:
A client sees this warning on their machine for text generation, still works:
```
Unable to create a device from version 1.614.0 of the DirectX 12 Agility SDK.
You can still use this library, but some scenarios may not work.
```
When using vision, they get this additional error:
```
024-07-26 21:15:53.1830129 [E:onnxruntime:onnxruntime-genai, sequential_executor.cc:516
onnxruntime::ExecuteKernel] Non-zero status code returned while running MemcpyToHost node.
Name:'Memcpy_token_5' Status Message:
Error: Non-zero status code returned while running MemcpyToHost node. Name:'Memcpy_token_5'
```
Machine specs:
```
Ryzen 7 4700u, 16gb ram, igpu Vega 7, ssd, Windows 11
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.