intel / intel/AI-Playground

ai-backend crashes with Intel ARC 770 GPU / pytorch 2.4

Open
#188 1 comment 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
979
Forks
132
Avg merge
9h 23m
Merged PRs (30d)
8

Description

## Describe the bug

ai-backend crashes with Intel ARC 770 GPU

`
[ai-backend]: from sd_adapter import SD_SSE_Adapter
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 76, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\sd_adapter.py", line 7, in

[ai-backend]: import paint_biz
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 80, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\paint_biz.py", line 28, in
from realesrgan import RealESRGANer
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 76, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\realesrgan.py", line 14, in
import xpu_hijacks
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 80, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\xpu_hijacks.py", line 12, in
device_supports_fp64 = torch.xpu.has_fp64_dtype()
^^^^^^^^^^^^^^^^^^^^^^^^^^`

Seems like this is a known issue with pytorch 2.4
https://github.com/intel/intel-xpu-backend-for-triton/issues/1840

additionally the device is not recognized:

`[lslevelzero]: Detecting device
[lslevelzero]: Spawning command C:\Program Files\AI Playground\resources\ai-backend-env\Library\bin\ls_level_zero.exe
[lslevelzero]: Extra env: {"ONEAPI_DEVICE_SELECTOR":"level_zero:*"}
[lslevelzero]: Failed to detect device due to Error: command C:\Program Files\AI Playground\resources\ai-backend-env\Library\bin\ls_level_zero.exe failed 3221226505
[lslevelzero]: No supported device`

## Environment (please complete the following information):

- OS: [ Windows11]
- GPU: [e.g. Intel Arc A770 16G]
- CPU: [e.g. i5-10505]

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.