google / google/aqt

Add support for native asymmetric quantization to AQTv2.

Open
#725 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
361
Forks
33
Avg merge
18h 9m
Merged PRs (30d)
4

Description

AQTv2 supports biases and will soon support asymmetric quantization, but only via fake quantization. Supporting native integer asymmetric quantization requires calculating the cross terms in `DotGeneralQuantizer` (AQTv2's `conv` and `dot_general` operation quantizer).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.