alibaba / alibaba/EasyNLP

序列标注预测数据格式问题

Open
#198 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.2k
Forks
257
PR merge metrics
No merged PRs in 30d

Description

代码位置`easynlp.appzoo.sequence_labeling.predictor.py`
`SequenceLabelingPredictor.preprocess`
```python
text_a = record[self.first_sequence] if self.tokenized else " ".join(record[self.first_sequence])
# record[self.first_sequence] = '中 国 最 棒'
# text_a = '中 国 最 棒' (多加了一个空格)
```
除非指明要预测的序列不包含空格间隔,不然会多一个空格。

Contributor guide

No contributing guide indexed for this repository

Research direction

Open easynlp.appzoo.sequence_labeling.predictor.py and start with SequenceLabelingPredictor.preprocess. Reproduce the shown input where record[self.first_sequence] is tokenized with spaces and compare the resulting text_a. Done means prediction input does not gain an extra space unless the sequence is explicitly intended to contain space separators.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.