google / google/ruy

Question about performance comparison

Open
#323 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
325
Forks
97
PR merge metrics
No merged PRs in 30d

Description

Hi.
I was looking for a performance comparison between `ruy` and `OpenBLAS` and I came across [this](https://github.com/google/ruy/issues/270#issuecomment-862699301).
But when I benchmark the ruy (almost for any shape with single thread execution and on raspberry pi 4), my results are far behind the reported results.
For example, for the 512x512x512 Int8 benchmark, I can only get ~10 GOPs but excel reported 40 GOPs.
I know Raspberry Pi 4 CPU frequency can be maxed out to 1.5 GHz while Pixel 4 max frequency is 2.84 GHz, but it does not justify the 30 GOPs gap.
So I thought it might be better to ask it here.
How did you measure GOPs for ruy?
I calculate the GOPs for the method with the `((2 * N * K * M * iterations) / time) / 10e+9` formula (`time` is the sum of the execution time of `ruy::Mul` for each iteration) (I pack the RHS matrix beforehand).
Am I doing anything wrong?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.