allenai / allenai/scibert

Domain specific terms

未关闭
#120 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
1.7k
派生
232
PR 合并指标
30 天内没有已合并 PR

描述

Hi,
I want to pretrain SciBERT using additional data, and I want to enlarge the vocabulary with 100 additional "domain-specific" terms which are reserved for such usage.
So I've figured out a way to extract a list of terms from my data.

Let's supposed I have the following most relevant terms:
```
"polymer"
"materials"
"chemistry"
"polymers"
```

what should I do with the terms such as `polymer` and `polymers`? Include them both? or keep the singular only?

Does anybody have information or recommendation on this?

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。