intel / intel/llvm

Support memcpy between iGPU and dGPU.

Open
#21,087 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
LLVM
Stars
1.5k
Forks
854
Avg merge
3d 17h
Merged PRs (30d)
137

Description

### Is your feature request related to a problem? Please describe

In llama.cpp for SYCL backend, current solution of memory copying between iGPU and dGPU is device-host-device.
With the iGPU (built-in GPU) become powerful, it's possible to run the LLM on iGPU and dGPU in parallel for different functions.

Currently, the iGPU and dGPU are different platform type and do not support memory copy between them.
We need the feature to support memcpy between iGPU and dGPU directly.

In other area, iGPU cooperate with dGPU would have more usage.
The communication between iGPU and dGPU become more important and the low efficiency of mem-copy would become the bottle-neck.

Thank you!

### Describe the solution you would like

_No response_

### Describe alternatives you have considered

_No response_

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.