ROCm / ROCm/AMDMIGraphX

Reporting kernel efficiency

Open
#845 2 comments 0 reactions 2 assignees View on GitHub

@mvermeulen is already working on this.

Since Jun 1, 2021.

Dominant language
C++
Stars
333
Forks
150
Avg merge
4d 19h
Merged PRs (30d)
54

Description

Many rocm libraries, including miopen and rocblas, support modes where kernel efficiency is calculated and displayed. This enables easy identification of low hanging fruits for performance optimization. For example, kernels that have efficiency less than 50% should be investigated. The less the kernel efficiency, the higher the likelihood that the kernel needs investigation/improvement.

The feature request in this issue is to support such an introspection mode in migraph as well.

A foundational element of this is in issue:
https://github.com/ROCmSoftwarePlatform/AMDMIGraphX/issues/844
which will allow an objective measurement of gpu time.

Further required element is an idea of how much data is processed by the kernel. This can be deduced either "by hand", given the problem size (miopen does this, for example), or, for extra credit, from GPU profiling. In either case, a measure of kernel efficiency can be produced and reported.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.