On your R2 rotation Matrix

In multi-head attention, the rotation matrix must be block-diagonal with one block per head. Why does SpinQuant train a single shared R2 matrix of shape [head_dim, head_dim] and replicate it across all heads (creating a block-diagonal with identical blocks), rather than training independent rotation matrices for each head?