alteryx / alteryx/nlp_primitives

Add tfidf primitive

未关闭
#71 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
37
派生
13
PR 合并指标
30 天内没有已合并 PR

描述

> tf–idf, TF*IDF, or TFIDF, short for term frequency–inverse document frequency, is a numerical statistic that is intended to reflect how important a word is to a document in a collection or corpus
- https://en.wikipedia.org/wiki/Tf%E2%80%93idf
- Found [here](https://github.com/DataCanvasIO/Hypernets/blob/4ff86cdebc7e15636900aa26b3a9db6154d543a1/hypernets/tabular/feature_generators/_primitives.py#L98):

```python
class Tfidf(TransformPrimitive):
name = 'tfidf'
input_types = [NaturalLanguage]
return_dtype = Numeric
commutative = True

@property
def number_output_features(self):
pass

```

- Allow the user to pass in the corpus
- We should name the primitive similar to LSA (https://github.com/alteryx/nlp_primitives/pull/161)

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。