mlcommons / mlcommons/power-dev
High overhead of power measurements for CPU inference measurements
Open
@psyhtest is already working on this.
Since May 5, 2021.
Investigate
- Dominant language
- Python
- Stars
- 28
- Forks
- 30
- PR merge metrics
- No merged PRs in 30d
Description
During the MLPerf Inference v1.0 round, I noticed that the power workflow when used with CPU inference occasionally seemed to incur a rather high overhead (~10%), for example:
-
Xavier with power measurements:
- ArmNN v21.02: 68.5 ms
- TFLite v2.4.1: 78.0 ms
-
Xavier without power measurements (compliance):
- ArmNN v21.02: 60.2 ms
- TFLite v2.4.1: 78.5 ms
Here, ArmNN is faster than TFLite but takes a big hit under the power workflow. TFLite, however, is not affected.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.