LinearA16 and LinearW2A16 output does not match

使用decoupleQ压缩llama-3-8b，使用 fake_quant - linearA16 的计算结果和true_quant - linearW2A16的计算结果不match
截图中，左边是linearW2A16的输出，右边是linearA16的输出
input数据类型是bfloat16

请问这种情况可能的原因是什么呀？

Start by reproducing the llama-3-8b decoupleQ case described in the issue, comparing fake_quant with linearA16 against true_quant with linearW2A16. Check the behavior with bfloat16 input and use the attached screenshot as the expected mismatch reference. Done means identifying and documenting the cause of the differing outputs.

Written by the indexing model from the issue text.