bytedance / bytedance/AffineQuant

Why doesn't the optimization goal include Quantized X

Open
#4 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
31
Forks
6
PR merge metrics
No merged PRs in 30d

Description

Hi there, I am a rookie in model quantization. I've read your paper and the results are impressing! However, I couldn't help but wonder, in your optimization problem, you use the below formula:
![截屏2024-08-30 00 10 09](https://github.com/user-attachments/assets/642841c7-8a32-45bd-bf93-f7f80b6f0879)

Why not use Q(XA^(-1))Q(AW) as part of the optimization goal. Wouldn't it help if the quantization error on X is also taken into account?

I hope my silly question won't bother you 😊./

Best regards.

Contributor guide

No contributing guide indexed for this repository

Research direction

Read the paper's optimization formulation and locate the corresponding objective in the Python implementation; no file, test, or entry point is named in the issue. Establish whether the proposed quantization term is intended, then document the rationale or define an agreed implementation and validation target.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.