acl-org / acl-org/reviewer-paper-matching
NAACL 2021 trying to run COI/reviewer assignments
- 主要言語
- Python
- スター
- 26
- フォーク
- 4
- PR マージ指標
- 30日以内にマージされた PR はありません
説明
Trying to run this code for NAACL 2021, got some questions:
- What is the `Track` field, is it different from `Subject Area`? Is `Secondary Subject Area` ever used?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/softconf_extract.py#L90
- Can assignment papers to ACs be handled by `suggest_reviewers.py` with a filtered `reviewers.jsonl` file? `suggest_ac_reviewers_by_track.py` seems to have a hard-coded link to `Moving-to-COI-Track.csv`:
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_ac_reviewers_by_track.py#L276
Could this be added to `README`?
- What is the file structure of `Moving-to-COI-Track.csv` and what is the "Move to" column?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_ac_reviewers_by_track.py#L281
- Where is the COI detection done? The COI detection repository mentioned in this issue:
https://github.com/acl-org/reviewer-paper-matching/issues/13
is not available:
https://github.com/acl-org/reviewer-coi-detection
In the current repository, COI detection seems to be only dealt in `suggest_ac_reviewers_by_track.py`.
Could this be clarified in `README`?
- Why `calc_reviewer_db_mapping` does not have `author_col` argument anymore? Is it safe to remove it from the function calls in `suggest_reviewers.py`?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_reviewers.py#L192
Also notice that the documentation for this field still exists:
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_utils.py#L20
- `requirements.txt` seems to be missing a few things.
コントリビューションガイド
このリポジトリのコントリビューションガイドは索引されていません
調査の方向性
Read README and the referenced entry points in softconf_extract.py, suggest_reviewers.py, suggest_ac_reviewers_by_track.py, and suggest_utils.py. Trace the Track, Moving-to-COI-Track.csv, COI detection, calc_reviewer_db_mapping, and requirements.txt questions against the current code. Done means the README and dependency documentation answer these questions accurately.
索引モデルが issue の本文から書いたものです。
評価
- 技術スタック
- python
- 領域
- documentation
- issue の種類
- ドキュメント
- 難易度
- 4/5
- 見積もり時間
- 3〜5日
- 活発さ
- 停滞
- 明瞭さ
- 説明が足りない
- 初心者へのやさしさ
- 35/100