Inference新文档中有生单词问题
Open
- Dominant language
- Java
- Stars
- 196
- Forks
- 139
- PR merge metrics
- No merged PRs in 30d
Description
首先感谢hankcs博主的分享,在使用LDA4j的过程中,我重写了Corpus类里的load和loadDocument方法,从数据库中读写数据测试成功。
但是测试的过程中遇到了一个问题,就是先用训练集训练出来phi,然后拿来一个新文档使用这个phi推断其概率分布发现报数组越界的错误,我初步调试发现一旦新文档中包含训练集中没有的生单词,你写的Inference便无法使用,这个问题希望博主能进行一下异常处理。
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing inference with a document containing a word absent from the training set, then inspect the Inference implementation and the Corpus.load and loadDocument methods mentioned in the report. Trace the array-bounds failure and define handling for unseen words; done means inference no longer crashes for such documents and the behavior is covered by a regression test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100