google / google/gemmlowp

is D in your fomation (2) calculated by this?

Open
#204 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
1.8k
Forks
461
PR merge metrics
No merged PRs in 30d

Description

max = scale * (255 - zero_point);
min = scale * (0 - zero_point);

and this zero_point and scale both are real number , so is not calculated like what i do ?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.