allenai / allenai/specter

Matching articles from SPECTER's dataset with S2ORC IDs

未关闭
#37 1 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
592
派生
58
PR 合并指标
30 天内没有已合并 PR

描述

Hi,

I want to match articles used in SPECTER's training and validation sets with the articles from S2ORC.
The problem is that article IDs in SPECTER's [training and validation sets](https://github.com/allenai/specter/issues/2) are not used in the S2ORC dataset, i.e., S2ORC uses different paper IDs compared to SPECTER.

For example, [this article](https://www.semanticscholar.org/paper/793efec2096f6511c45430ff5f2f08a362dcf3eb) can be found in SPECTER's validation set and its ID there is: `793efec2096f6511c45430ff5f2f08a362dcf3eb`.
Corpus ID of this paper is `11967120` and this Corpus ID is used in S2ORC as `paper_id`. (I've found this Corpus ID on the Semantic Scholar's webpage linked above)

Is there any easy way to obtain these Corpus IDs for articles from SPECTER's dataset?
I'm aware I could use Semantic Scholar's API for this, but I think that would be very time-consuming (SPECTER's dataset contains over 165k unique article IDs if I calculated correctly).

Thanks!

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。