ai-backend crashes with Intel ARC 770 GPU / pytorch 2.4
- Dominant language
- TypeScript
- Stars
- 979
- Forks
- 132
- Avg merge
- 9h 23m
- Merged PRs (30d)
- 8
Description
## Describe the bug
ai-backend crashes with Intel ARC 770 GPU
`
[ai-backend]: from sd_adapter import SD_SSE_Adapter
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 76, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\sd_adapter.py", line 7, in
[ai-backend]: import paint_biz
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 80, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\paint_biz.py", line 28, in
from realesrgan import RealESRGANer
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 76, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\realesrgan.py", line 14, in
import xpu_hijacks
File "C:\Program Files\AI Playground\resources\ai-backend-env\Lib\site-packages\ipex_llm\utils\ipex_importer.py", line 80, in custom_ipex_import
return RAW_IMPORT(name, globals, locals, fromlist, level)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Program Files\AI Playground\resources\service\xpu_hijacks.py", line 12, in
device_supports_fp64 = torch.xpu.has_fp64_dtype()
^^^^^^^^^^^^^^^^^^^^^^^^^^`
Seems like this is a known issue with pytorch 2.4
https://github.com/intel/intel-xpu-backend-for-triton/issues/1840
additionally the device is not recognized:
`[lslevelzero]: Detecting device
[lslevelzero]: Spawning command C:\Program Files\AI Playground\resources\ai-backend-env\Library\bin\ls_level_zero.exe
[lslevelzero]: Extra env: {"ONEAPI_DEVICE_SELECTOR":"level_zero:*"}
[lslevelzero]: Failed to detect device due to Error: command C:\Program Files\AI Playground\resources\ai-backend-env\Library\bin\ls_level_zero.exe failed 3221226505
[lslevelzero]: No supported device`
## Environment (please complete the following information):
- OS: [ Windows11]
- GPU: [e.g. Intel Arc A770 16G]
- CPU: [e.g. i5-10505]
Contributor guide
Assessment
This issue has not been assessed yet.