selfteaching / selfteaching/selfteaching-python-camp
Day09 的中文分词大家是怎么实现的？
Open
Nobody has claimed this yet.
question
- Dominant language
- Python
- Stars
- 151
- Forks
- 875
- PR merge metrics
- No merged PRs in 30d
Description
今天作业的最后竟然是中文分词输出统计结果。我查了一下网上有说是直接调用一些工具，结巴，但是并不知道其中分词原理又怕后面涉及到不方便修改，就像自己写代码实现。一个思路就是与一个现有的词典文件比对分割，我找到了一个txt文件，不过他还是带有词汇解释的那种，不是单独的词汇，其他代码照着敲好了，但是现在应该是制作比对词典这里有点问题。大家怎么操作的，或者有没有方便使用的词组文件？
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start from the existing code mentioned in the issue and inspect the TXT dictionary containing vocabulary explanations. Determine how the dictionary should support the requested Chinese word-segmentation statistics; completion is a working dictionary-based output, but the issue does not name files or tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100