allenai / allenai/scholarphi

Entity Localization Bug: Sentence. Doubly-detected sentence in many papers.

オープン
#187 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る
bad-entity-detection bug entity-localization sentences
主要言語
Python
スター
428
フォーク
58
PR マージ指標
30日以内にマージされた PR はありません

説明

_Description_: In some papers, the same sentence gets detected twice. This can be observed by opening up that paper in the reader interface (i.e., https://scholarphi.semanticscholar.org/?file=https://arxiv.org/pdf/[PAPER_ID].pdf&preset=demo) and then entering the following CSS in the web inspector.

```css
.sentence-annotation {
background-color: rgba(0, 0, 255, 0.2);
}
```

Here is an example of a duplicated sentence (the sentence "Our decoder..."), from paper 1702.01287v1:

![image](https://user-images.githubusercontent.com/2358524/103590379-8d773380-4ea2-11eb-8b03-61ede47bd761.png)

Additional papers I have seen this for include (out of the list of papers that can be seen here https://github.com/allenai/scholarphi/issues/188):
* 1701.07481v3
* 1702.01287v1
* 1701.02810v2
* 1805.08660v1
* 1906.00414v2
* 1906.01502v1
* 1908.00300v1
* 1905.05475v2
* 1706.08482v1
* 1704.05838v1
* 1903.00621v1
* 1705.06566v2
* 1806.02371v1
* 1901.10159v1
* 1811.12359v4
* 1707.00683v3 (first page)
* 1711.08028v4
* 1905.10887v2

Here are some additional notes:
* For some papers, doubly-detected sentences seem to occur at the first sentence of the section (1908.00300v1, 1905.05475v2)

_How to fix_: I don't know the definitive cause of the error.

However, I suspect that one cause is that our pipeline used to color multiple entities the same color. This was recently fixed in #180. It could be that when we run the pipeline again, we see many of these duplicates disappear.

If this issue persists, then here are some ideas for fixes. One potential fix is to deduplicate sentences; if two sentences have overlapping bounding boxes, then filter out one of them.

Another potential fix is to skip processing detecting sentences that are not marked as "clean" by the sentence detector, i.e., which contain less than 2 English words in them, in order to strip out LaTeX junk. This assumes that most of the doubly-detected sentences are detected twice because the second instance of the sentence is just a junk sentence that appeared right before or after a clean sentence, though which got colorized using the same character offsets.

This issue may be low severity. I do not know if it impacts the behavior of clutter, though if it does not, we may be able to ignore this error.

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。