训练自定义词性报错 Data type error
Open
- Dominant language
- C++
- Stars
- 4k
- Forks
- 592
- PR merge metrics
- No merged PRs in 30d
Description
2020-08-17 00:34:46,119-WARNING: Data type error: /xwkpv
由于加载自定义词速度比较慢
大约 19M的txt文件 30秒甚至一分钟也处理不完
所以考虑自己训练模型
但是词性也是自定义的,如何添加自定义词性呢?
我找到了 配置文件
/root/anaconda3/envs/paddle/lib/python3.7/site-packages/LAC/lac_model/conf
tag.dic 这里存储的是词性, 这个文件如何 生成?
自定义训练模型时,如何 处理,谢谢。
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by inspecting the mentioned LAC installation path and tag.dic, then trace how custom training reads the tag definitions and produces the reported Data type error. Done means documenting or correcting the process for generating tag.dic and training with custom part-of-speech tags.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100