microsoft / microsoft/onnxruntime-genai

Issues running on Ryzen

Open
#728 6 comments 1 reaction 1 assignee Claimed by @PatriceVignola View on GitHub
ep:DML platform:windows waiting-for-customer
Dominant language
C++
Stars
1.1k
Forks
354
Avg merge
2d 16h
Merged PRs (30d)
85

Description

Using phi3 vision model:

A client sees this warning on their machine for text generation, still works:
```
Unable to create a device from version 1.614.0 of the DirectX 12 Agility SDK.
You can still use this library, but some scenarios may not work.
```

When using vision, they get this additional error:
```
024-07-26 21:15:53.1830129 [E:onnxruntime:onnxruntime-genai, sequential_executor.cc:516
onnxruntime::ExecuteKernel] Non-zero status code returned while running MemcpyToHost node.
Name:'Memcpy_token_5' Status Message:
Error: Non-zero status code returned while running MemcpyToHost node. Name:'Memcpy_token_5'
```

Machine specs:
```
Ryzen 7 4700u, 16gb ram, igpu Vega 7, ssd, Windows 11
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.