allenai / allenai/scispacy

Clean up vocab creation

未關閉
#300 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
code improvement
主要語言
Python
星號
2k
分支
258
PR 合併指標
30 天內沒有已合併 PR

描述

This script is getting quite a few steps removed from the original corpus now. It might be better to convert this to a script which reads a large corpus and creates the vocabularies directly, rather than us having created this intermediate file with the word/doc counts in it, and then having this one generate a vocabulary file which is not substantially different apart from how it is filtered.

_Originally posted by @DeNeutoy in https://github.com/allenai/scispacy/pull/295#discussion_r558664660_

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。