hankcs / hankcs/LDA4j

Inference新文档中有生单词问题

Open
#6 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
196
Forks
139
PR merge metrics
No merged PRs in 30d

Description

首先感谢hankcs博主的分享,在使用LDA4j的过程中,我重写了Corpus类里的load和loadDocument方法,从数据库中读写数据测试成功。
但是测试的过程中遇到了一个问题,就是先用训练集训练出来phi,然后拿来一个新文档使用这个phi推断其概率分布发现报数组越界的错误,我初步调试发现一旦新文档中包含训练集中没有的生单词,你写的Inference便无法使用,这个问题希望博主能进行一下异常处理。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing inference with a document containing a word absent from the training set, then inspect the Inference implementation and the Corpus.load and loadDocument methods mentioned in the report. Trace the array-bounds failure and define handling for unseen words; done means inference no longer crashes for such documents and the behavior is covered by a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.