allenai / allenai/longformer

sentence and paragraph prediction for hotpotqa

未关闭
#142 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
2.2k
派生
286
PR 合并指标
30 天内没有已合并 PR

描述

Hi

In the page 14 of the paper,
> For evidence extraction we apply 2 layer feedforward networks on top of the representations corresponding to sentence and paragraph tokens to get the corresponding evidence prediction scores and use binary cross entropy loss to train the model.

Is the 2 layer feedforward networks something likes
```
torch.nn.Sequential(
torch.nn.Linear(self.model.config.hidden_size, self.model.config.hidden_size)
torch.nn.ReLU(),
torch.nn.Linear(self.model.config.hidden_size, 1), # score for 'yes', while 0 for 'no'
)
```

Besides, do you predict sentence and paragraphs separately or nested? The reason I ask is that gold sentences are always inside of gold paragraphs. When predict and compute the support f1, does a sentence considered as predicted positive has to be within a paragraph predicted positive? Do you use a hard threshold for both sentence and paragraph prediction?

Thank you

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。