iree-org / iree-org/fusilli

Support dynamic transient workspace size queries

Open
#400 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
25
Forks
16
PR merge metrics
No merged PRs in 30d

Description

Fusilli currently assumes transient workspace size can be read as a constant from IREE module metadata. Dynamic-shape graphs that need runtime-dependent workspace sizes expose an iree.abi.transients.size function instead, and Graph::getWorkspaceSize() reports NOT_IMPLEMENTED.

This blocks running dynamic-shape multiple-dispatch cases such as dynamic batch MIN/MAX reductions. Add support for invoking the size function with runtime variant-pack shapes, then allocate and pass the resulting workspace.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.