allenai / allenai/scibert

JNLPBA dataset

未关闭
#26 3 条评论 0 个 reaction 已指派 1 人 已被 @kyleclo 认领 在 GitHub 查看
主要语言
Python
星标
1.7k
派生
232
PR 合并指标
30 天内没有已合并 PR

描述

Hi,

thanks for releasing the `SciBERT` model and datasets :heart:

I'm currently integrating an importing method of the NER data into the [flair](https://github.com/zalandoresearch/flair) library.

I checked the number of imported sentences for all dataset splits and there's a mismatch of 2404 sentences compared to the total sentences number in table 2 of the paper (24,806). Then I checked the JNLPBA dataset and it seems that all `-DOCSTART- O` lines were also counted, which is I think a bit redundant.

The number of training and development sentences is also a bit different than the values reported in the BioBERT paper. The BioBERT uses a split of 14,690 / 3,856 / 3,856, whereas the provided data in this repository uses a split of 16,807 / 1,739 / 3,856. Could you confirm this?

Thanks + regards,

Stefan

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。