baidu / baidu/lac

训练自定义词性报错 Data type error

Open
#115 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
4k
Forks
592
PR merge metrics
No merged PRs in 30d

Description

2020-08-17 00:34:46,119-WARNING: Data type error: /xwkpv

由于加载自定义词速度比较慢
大约 19M的txt文件 30秒甚至一分钟也处理不完
所以考虑自己训练模型
但是词性也是自定义的,如何添加自定义词性呢?

我找到了 配置文件
/root/anaconda3/envs/paddle/lib/python3.7/site-packages/LAC/lac_model/conf

tag.dic 这里存储的是词性, 这个文件如何 生成?
自定义训练模型时,如何 处理,谢谢。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by inspecting the mentioned LAC installation path and tag.dic, then trace how custom training reads the tag definitions and produces the reported Data type error. Done means documenting or correcting the process for generating tag.dic and training with custom part-of-speech tags.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.