acl-org / acl-org/reviewer-paper-matching

NAACL 2021 trying to run COI/reviewer assignments

オープン
#23 コメント 1 件 リアクション 0 件 担当者 0 名 GitHub で見る
主要言語
Python
スター
26
フォーク
4
PR マージ指標
30日以内にマージされた PR はありません

説明

Trying to run this code for NAACL 2021, got some questions:
- What is the `Track` field, is it different from `Subject Area`? Is `Secondary Subject Area` ever used?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/softconf_extract.py#L90
- Can assignment papers to ACs be handled by `suggest_reviewers.py` with a filtered `reviewers.jsonl` file? `suggest_ac_reviewers_by_track.py` seems to have a hard-coded link to `Moving-to-COI-Track.csv`:
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_ac_reviewers_by_track.py#L276
Could this be added to `README`?
- What is the file structure of `Moving-to-COI-Track.csv` and what is the "Move to" column?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_ac_reviewers_by_track.py#L281
- Where is the COI detection done? The COI detection repository mentioned in this issue:
https://github.com/acl-org/reviewer-paper-matching/issues/13
is not available:
https://github.com/acl-org/reviewer-coi-detection
In the current repository, COI detection seems to be only dealt in `suggest_ac_reviewers_by_track.py`.
Could this be clarified in `README`?
- Why `calc_reviewer_db_mapping` does not have `author_col` argument anymore? Is it safe to remove it from the function calls in `suggest_reviewers.py`?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_reviewers.py#L192
Also notice that the documentation for this field still exists:
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_utils.py#L20
- `requirements.txt` seems to be missing a few things.

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

調査の方向性

Read README and the referenced entry points in softconf_extract.py, suggest_reviewers.py, suggest_ac_reviewers_by_track.py, and suggest_utils.py. Trace the Track, Moving-to-COI-Track.csv, COI detection, calc_reviewer_db_mapping, and requirements.txt questions against the current code. Done means the README and dependency documentation answer these questions accurately.

索引モデルが issue の本文から書いたものです。

評価

技術スタック
python
領域
documentation
issue の種類
ドキュメント
難易度
4/5
見積もり時間
3〜5日
活発さ
停滞
明瞭さ
説明が足りない
初心者へのやさしさ
35/100

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。