iree-org / iree-org/iree

[HAL] Device side command buffer execute

Open
#14,596 3 comments 0 reactions 2 assignees Claimed by @antiagainst View on GitHub
enhancement ➕ hal/api hal/cuda
Dominant language
C++
Stars
3.9k
Forks
1k
Avg merge
4d 16h
Merged PRs (30d)
47

Description

### Request description

CUDA graph allow to launch graphs from device (*), and it allows to implement on-device while loops, while today they are forced to do a roundtrip to host to get the predicate value from device.

Looking at HAL, it doesn't look like this can be expressed in the current API. Anything like that on the vulkan/metal side? Can this be added to HAL and be backend-agnostic-enough?

(*) https://developer.nvidia.com/blog/enabling-dynamic-control-flow-in-cuda-graphs-with-device-graph-launch/

### What component(s) does this issue relate to?

Runtime

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.