acl-org / acl-org/reviewer-paper-matching

NAACL 2021 trying to run COI/reviewer assignments

Đang mở
#23 1 bình luận 0 reaction 0 người được giao Xem trên GitHub
Ngôn ngữ chính
Python
Star
26
Fork
4
Chỉ số merge pull request
Không có pull request nào được merge trong 30 ngày

Mô tả

Trying to run this code for NAACL 2021, got some questions:
- What is the `Track` field, is it different from `Subject Area`? Is `Secondary Subject Area` ever used?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/softconf_extract.py#L90
- Can assignment papers to ACs be handled by `suggest_reviewers.py` with a filtered `reviewers.jsonl` file? `suggest_ac_reviewers_by_track.py` seems to have a hard-coded link to `Moving-to-COI-Track.csv`:
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_ac_reviewers_by_track.py#L276
Could this be added to `README`?
- What is the file structure of `Moving-to-COI-Track.csv` and what is the "Move to" column?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_ac_reviewers_by_track.py#L281
- Where is the COI detection done? The COI detection repository mentioned in this issue:
https://github.com/acl-org/reviewer-paper-matching/issues/13
is not available:
https://github.com/acl-org/reviewer-coi-detection
In the current repository, COI detection seems to be only dealt in `suggest_ac_reviewers_by_track.py`.
Could this be clarified in `README`?
- Why `calc_reviewer_db_mapping` does not have `author_col` argument anymore? Is it safe to remove it from the function calls in `suggest_reviewers.py`?
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_reviewers.py#L192
Also notice that the documentation for this field still exists:
https://github.com/acl-org/reviewer-paper-matching/blob/674734a566ed7dfaa738b9ee7f20048fe2ff9730/suggest_utils.py#L20
- `requirements.txt` seems to be missing a few things.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Hướng nghiên cứu

Read README and the referenced entry points in softconf_extract.py, suggest_reviewers.py, suggest_ac_reviewers_by_track.py, and suggest_utils.py. Trace the Track, Moving-to-COI-Track.csv, COI detection, calc_reviewer_db_mapping, and requirements.txt questions against the current code. Done means the README and dependency documentation answer these questions accurately.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Đánh giá

Công nghệ
python
Lĩnh vực
documentation
Loại issue
Tài liệu
Độ khó
4/5
Thời gian dự kiến
3-5 ngày
Mức độ hoạt động
Đình trệ
Độ rõ ràng
Cần làm rõ
Mức phù hợp với người mới
35/100

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.