acl-org / acl-org/acl-anthology
Broken & missing links on the server
- Ngôn ngữ chính
- Python
- Star
- 797
- Fork
- 408
- Merge trung bình
- 3 ngày 19 giờ
- Pull request đã merge (30 ngày)
- 36
Mô tả
I have crosschecked a full file list from the aclweb.org server (created by @mjpost on 29.03.2019) with what would be expected after parsing the Anthology XML.
The result is a list of files that are either **missing** (= they should currently be linked on the website, but will 404) or **unexpected** (= they are on the server, but not currently linked).
## Most recent status in [this comment](https://github.com/acl-org/acl-anthology/issues/264#issuecomment-615910423).
It reveals a swath of problems, for example:
+ Journals that have front matter (as discussed in #181) will show up as "unexpected", e.g.:
Unexpected: J98-1000.pdf
+ Attachments that appear to have wrong names in the XML, e.g.:
Unexpected: P16-1070.Notes.pdf
Missing: P16-1070.Notes.zip
+ Something weird going on with [EACL 1997](https://www.aclweb.org/anthology/events/eacl-1997/); papers are listed twice—once as E97-, once as P97- (probably a joint meeting?)—with the E97-* files not actually existing on the server.
+ Some of them are also **false alarms,** e.g., a bunch of TACL papers show up as missing, such as:
Missing: Q18-1006.pdf
Missing: Q18-1034.pdf
Missing: Q18-1035.pdf
But the URLs for them actually work: [Q18-1006](https://www.aclweb.org/anthology/Q18-1006), [Q18-1034](https://www.aclweb.org/anthology/Q18-1034), [Q18-1035](https://www.aclweb.org/anthology/Q18-1006). The same applies to (many of?) the seemingly missing revisions & errata. Maybe there's some redirection magic going on on the server to places that are not included in the file list I've got?
+ Potentially many more.
## What next?
Lines that stem from clear mistakes in the XML could obviously be manually fixed.
For journals that have front matter, and also for full volume PDFs, we could mark in the XML if these files actually exist or not (e.g., by providing—and relying on—an explicit `` or `` tag, as discussed in #156.
I can also update the gist after we commit corrections and/or I get an updated file list.
Hướng dẫn đóng góp
Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này
Hướng nghiên cứu
Start with the full server file list referenced in the issue and the Anthology XML parsing output, then review the latest status in the linked comment. Separate XML mistakes, front matter and full-volume cases, redirects, and EACL 1997 duplicates. Done means the discrepancies are classified and the agreed XML or metadata corrections are recorded and verifiable.
Do mô hình lập chỉ mục viết ra từ nội dung của issue.
Đánh giá
- Công nghệ
- python, xml
- Lĩnh vực
- data
- Loại issue
- Lỗi
- Độ khó
- 5/5
- Thời gian dự kiến
- Hơn một tuần
- Mức độ hoạt động
- Đình trệ
- Độ rõ ràng
- Cần làm rõ
- Mức phù hợp với người mới
- 25/100