allenai / allenai/few-shot-comet

some questions

未关闭
#2 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
9
派生
0
PR 合并指标
30 天内没有已合并 PR

描述

I tried to use your code to analyze the output of a t5 model trained on Atomic. However my results are very different from yours. I use Huggingface t5 models however.

For angular change, only q has a large angular change and others are minor. Also for L1 change in decoder V and O and Ox have larger values.

Next question
I your code why you don't divide Wo and Wi matrixes on `amout_bigger`. In general what is the reason for these divisions on change and the constants for it

```
if name_of_matrix == "wi" or name_of_matrix == "wo":
change = amount_bigger * 1.048 * 1000000
else:
change = 1.048 * 1000000
```

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。