iree-org / iree-org/iree

Improve task system copy/fill distribution and avoid when not required on CPU.

Open
#16,366 0 comments 0 reactions 1 assignee Claimed by @benvanik View on GitHub
hal/cpu performance ⚡ runtime/tools
Dominant language
C++
Stars
3.9k
Forks
1k
Avg merge
4d 16h
Merged PRs (30d)
47

Description

#14601 highlighted how poorly the copy/fill logic performs today as it doesn't take into account the number of available workers and instead just uses a fixed small workgroup size to divide the problem size. It also highlighted that we always perform the transfers even when we can map host memory directly and that should be fixed. These are silly.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.